Product Evals Engineer, ChatGPT Learning

As a Product Evals Engineer, you will lead the development of systems that evaluate response quality across ChatGPT’s learning experiences. You will define what excellent responses looks like for learners, translate those principles into measurable criteria, and build the infrastructure needed to evaluate performance at scale.

You will combine human judgment, automated evaluation, experimentation, and deep analysis to uncover quality issues and accelerate iteration. This work will span retrieval, ranking, answer quality, source selection and attribution, and end-to-end user outcomes. You will partner closely with model measurement team, product engineers, data scientists, and education experts to ensure our evaluation methods reflect both technical quality and genuine learning value.

This role is based in San Francisco, CA. We use a hybrid work model of three days in the office per week and offer relocation assistance to new employees.