- Experience with reinforcement learning from human feedback (RLHF), preference data, or model response evaluation.
- Familiarity with rubric design, model comparison, benchmark development, or evaluation creation.
- Experience assessing model responses for quality, accuracy, reasoning, or instruction following.
- Exposure to AI companies, frontier AI labs, or model evaluation programs.
- Bilingual capabilities, particularly German or a Nordic language.
Why You'll Love Working Here At Appen, we foster a culture of innovation, collaboration, and excellence. We value curiosity, accountability, and a commitment to delivering the highest quality AI solutions for frontier models.
You'll work on complex challenges that shape the future of AI across industries and geographies, alongside talented people in a culture that values humility over ego. You'll have the flexibility to deliver in a way that works for you and your team, supported by tools, resources, and development opportunities to continue to build your capability over time.