GenAI Platform Engineer

- Design, build, and maintain the highly reliable Model Serving Layer (Gateways, load balancing, caching, throttling) for low-latency access to LLMs and other generative models - Engineer and maintain production-ready Vector Database and Retrieval-Augmented Generation (RAG) infrastructure, including high-throughput indexing pipelines and efficient retrieval strategies for enterprise data - Develop and manage a standardised, secure Agent Framework/SDK that promotes consistency and maintainability across all agents built from the platform - Implement robust mechanisms for cost tracking, monitoring, and precise cost allocation/chargebacks per squad, alongside implementing rate-limiting and budget controls - Systematically benchmark, curate, and integrate the most cost-effective and performant models for distinct use cases - Build and maintain scalable, secure infrastructure and data pipelines for custom model fine-tuning requested by product teams - Architect and deploy platform-level safety filters (e.g., toxicity, PII masking, jailbreak prevention) that are enforced across all model inputs and outputs - Build and maintain the centralised logging, monitoring, and observability stack to track crucial GenAI metrics (hallucination rate, latency, token usage, and drift detection) - Ensure the platform and RAG data handling adheres to strict compliance and data privacy regulations (e.g., GDPR) through automated enforcement and auditing - Drive the quality of the developer experience by writing exceptional SDKs, clear APIs, comprehensive documentation, and contributing to internal knowledge sharing (e.g. through workshops)