GenAI Platform Engineer – LLM Gateway
Pfizer, India - Remote
The role
The GenAI Platform Engineering team builds and runs the shared platform that lets Pfizer colleagues and applications use generative AI safely and at scale. At its core is the enterprise GenAI Gateway: a single, governed entry point to large language models from multiple providers, with self-service access, routing, usage and cost transparency, and observability built in. Around it, we deliver evaluation, observability and agentic tooling — MCP integrations, agent registries and reusable agent skills — for teams across the company.
We run the platform as a product: self-service over tickets, automation over manual approvals, small and frequent releases, and reliability we can measure. We are looking for a hands-on engineer to help evolve the Gateway and its ecosystem. You will keep it secure, fast and current in a fast-moving open-source landscape. You will work closely with a globally distributed team and with the teams that build on the platform.
This is an individual contributor role.
What you need
- Bachelor’s or Master’s degree in Computer Science, Computer Applications, Engineering or a related field, or equivalent practical experience.
- 9+ years of professional software engineering experience, including 3+ years building GenAI/LLM-based applications or platforms used in production.
- Strong Python skills for backend services: async programming, FastAPI or similar, REST APIs and streaming responses.
- Hands-on experience with LLM provider APIs (e.g., OpenAI, Azure OpenAI, AWS Bedrock), including tool/function calling and integrating multiple providers.
- Experience delivering and running services on AWS with containers and CI/CD pipelines (e.g., Docker, GitHub Actions), with automated testing built into the workflow.
- Proven ability to troubleshoot complex production issues and perform root-cause analysis.
- Clear written and verbal communication in English, and comfort working with distributed, cross-functional teams.
Nice to have
- Experience with an AI/LLM gateway or API gateway, including routing, key management and cost tracking.
- Experience running and extending open-source software in production, including patches, upgrades, regression testing and upstream contributions.
- Knowledge of agentic AI patterns and tooling:
- MCP
- LangGraph/LangChain or similar frameworks
- multi-agent orchestration
- RAG and vector search
- Experience with performance/load testing and observability tooling (e.g., OpenTelemetry, Langfuse, Prometheus/Grafana).