Senior Backend Engineer, AI Evaluations
Ellipsis Health, San Francisco - Hybrid
Ellipsis Health, San Francisco - Hybrid
We’re seeking a strong Senior Backend Engineer to join our AI Evaluation team, focused on building the infrastructure and internal tooling that enable reliable, repeatable evaluation of AI systems in production. In this role, you’ll develop the scaffolding around our evaluations platform - API/data integrations, test configuration management, and reporting tools that make evaluations easy to run, extend, and operate at scale. You’ll also build and maintain evaluation frameworks for individual system components such as ASR, LLMs, TTS, knowledge bases, and guardrails, productionalizing these frameworks to support regular analysis, regression detection, and continuous monitoring.
In addition, you’ll create debugging tools that make it easy to inspect end-to-end calls, trace failures, and surface all relevant signals in one place - empowering internal teams to diagnose issues quickly and confidently. The ideal candidate is a pragmatic, infrastructure-minded engineer who enjoys turning ad hoc analysis into durable systems, cares deeply about developer experience, holds a high bar for software-quality and takes pride in building tooling that makes complex AI systems observable, testable, and easier to operate.
As a health technology company, we reserve the right to run background checks on candidates to whom we extend offers, in compliance with applicable laws. We evaluate candidates holistically and comply with all “ban the box” regulations.
If you have a disability or require accommodations during the application or recruitment process, please contact careers@ellipsishealth.com.
We offer competitive salary and benefits, including 401(k) matching, health, vision, and dental insurance, and very flexible paid time off.
The typical salary range for this role is $175,000 to $250,000 USD, depending on skills, qualifications, and relevant experience.
Pay not posted
Posted Oct 8, 2026
ClickUpUnited States
$200K–$250K / yr
Posted 9 days ago
$300K–$350K / yr
Posted Oct 14, 2026
ASAPPMountain View +1
$190K–$220K / yr
Posted Sep 11, 2026
Source: the Ellipsis Health Ashby job board. We last checked this job 6 h ago. We first saw it 6 h ago. A job on a job board does not always mean that the team interviews people now. We found this job board in a public list. We did not yet compare it with the careers page of the company.
Bask Health 1United States
Pay not posted
Posted 4 days ago
Aircall.io, Inc.San Francisco Office
$181K–$250K / yr
Posted Sep 15, 2026
No one has reported an interview at Ellipsis Health yet. Did you interview there? Add the questions.
This base pay is near the median for senior software engineering jobs in the Bay Area.
We compare the middle of each posted range. This is base pay as posted. The group does not include this job.