Tech Lead, Applied AI - Evals

Mercor’s evals product helps frontier labs and enterprises understand how their models perform on real work. Labs use it to decide what to train next, and enterprises use it to decide which models and agents to trust. It runs evals at scale, grades every result and explains why a model fails. The team also runs APEX, Mercor's family of benchmarks built with domain experts to measure how well frontier models do professional work in fields like law, finance and consulting. Its public leaderboard ranks the latest models, and its results appear in model cards across the industry.

As the Tech Lead on the Evals team, you will own the evals product end to end. You will decide what the team builds next and stay hands-on in the code. The hard problems are in grading open-ended professional work reliably, keeping results reproducible as models and tasks change, and running long agent tasks at scale. The work is becoming as much a research problem as an engineering one.