Software Engineer, Evaluation Infrastructure
xAI, Palo Alto, CA
The role
The RL infrastructure team is looking for an engineer to help develop our evaluation infrastructure.
What you will do
- Build highly reliable, efficient, and easy to use infrastructure that runs all our evaluations at scale
- Collaborate closely with modeling & evaluation teams on developing new evals, maintaining evaluation signal quality, and building internal tooling to support training our next-generation of models
- Identify and resolve performance bottlenecks in all layers of the eval infrastructure stack, including inference, capacity fleet management, asynchronous eval orchestration, and more
What you need
- Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++