- Direct experience with LLM evaluation platforms, annotation systems, human-in-the-loop workflows, or agent orchestration.
- Strong backend or platform engineering background, particularly with distributed systems, workflow orchestration, or data infrastructure.
- Hands-on programming experience and comfort working across backend and frontend technologies.
- Experience with LLM-as-a-judge, custom evaluators, experiment tracking, datasets, or feedback-driven improvement workflows.
- Previous engineering experience or substantial hands-on software development experience.
- Early-stage or high-growth startup experience, particularly in founder-led environments.
The estimated annual salary for this role is between $200,000-$250,000, plus a competitive equity package. Actual compensation is determined based upon a variety of job related factors that may include: transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefit package, including: medical, dental, vision, 401(k) plan, unlimited paid time off, generous parental leave plan, and others for mental and wellness support.
While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.