RL Environment Engineer
Replay, New York
The role
Replay is hiring RL Environment Engineers who are looking to take real-world, enterprise data and convert it into model progression. You’ll recreate the entire world of businesses across industries — crafting the highest quality environments and evals while working directly with researchers to understand the capabilities they’re looking to hillclimb.
What you will do
- Design and build production-grade RL environments grounded in real enterprise workflows, from task spec through to a stable, versioned release
- Write reward functions and programmatic verifiers that score outcomes reliably, and harden them against reward hacking and shortcut solutions
- Build high-fidelity evaluation environments with seeded failure modes that expose subtle regressions, and reliable model and agent harnesses with bounded behaviour and explicit output verification
- Work directly with frontier lab researchers to understand the capability gaps they want to close, and design task suites that expose and train against them