Research Engineer - Eval Platform

Evaluation is how we decide which models, checkpoints and recipes ship. As a Research Engineer on the Eval Platform team, you will build the infrastructure every science team relies on to measure model quality, and make it reliable, reproducible and fast.

You don't need to have designed benchmarks before. You do need to care about what a score means, and about when a difference between two runs is real.

• Build systems that keep eval results reproducible and comparable over time, as models, benchmarks and code evolve.