LiteLLM is the world’s most popular open-source AI Gateway, used by Adobe, Netflix, NASA, NVIDIA and much of the Fortune 500. Every LLM call these companies make runs through our code, so when we break, they break. We’re a team of about 20, and we’re hiring senior and staff backend engineers to own the core of the gateway and keep it fast and reliable as traffic grows.
You’ll own critical parts of the LiteLLM proxy: routing, auth, caching, spend tracking, guardrails and observability. The job is to make these systems correct, fast and dependable at 1B+ requests a month. That means hunting down silent failures, fixing the root cause in code rather than adding another dashboard, and refactoring components that keep breaking without changing how they behave. You’ll set the bar for how our mostly early-career team writes, tests and ships backend code.
LiteLLM https://github.com/BerriAI/litellm is a Python SDK and proxy server for calling 100+ LLM APIs in the OpenAI format, with 60K+ GitHub stars.
LiteLLMSan Francisco
$200K–$260K / yr
Posted Jul 30, 2026
LiteLLMSan Francisco
$240K–$270K / yr
Posted Jul 30, 2026
LiteLLMSan Francisco
$250K–$300K / yr
Posted Jul 30, 2026
LiteLLMRemote (US)
$220K–$260K / yr
Posted Jul 30, 2026
Source: the LiteLLM Ashby job board. We last checked this job 2 h ago. We first saw it 2 h ago. A job on a job board does not always mean that the team interviews people now. We found this job board in a public list. We did not yet compare it with the careers page of the company.
$200K–$250K / yr
Posted Aug 7, 2026
LiteLLMSan Francisco +1
$220K–$280K / yr
Posted Jul 30, 2026
No one has reported an interview at LiteLLM yet. Did you interview there? Add the questions.
This base pay is above the median for staff software engineering jobs in the Bay Area.
We compare the middle of each posted range. This is base pay as posted. The group does not include this job.