Staff Engineer
LiteLLM, San Francisco
The role
You will own LiteLLM's product quality across a surface area that spans 100+ provider integrations and a large volume of outside contributions. Your mandate is to make quality automatic at our scale, without slowing down how fast we ship. You'll build the conformance testing, CI, and release infrastructure that catches problems before they reach production, and you'll set the bar on the code paths that matter most.
What you will do
- Own product quality end to end and drive regressions toward zero
- Build a provider conformance test suite covering streaming, tool calling, structured output, error mapping, cost tracking, and auth modes
- Own CI and release tooling that is fast, deterministic, and trusted enough that a red gate blocks a ship
- Build canary and synthetic traffic detection to catch upstream provider drift before customers do