AIML - Sr Machine Learning Platform Engineer, Evaluation

We are seeking a highly skilled and experienced machine learning engineer to join AIML Evaluation to build the systems that evaluate and refine Apple's foundation models and agents. As a key member of the team, you will help design and develop benchmarks, evaluators, simulation environments, and prompt and context optimization pipelines that drive quality improvements across Apple's AI experiences. You will collaborate with product teams and the foundation model team to close the loop between observation and improvement, contributing datasets, environments, and reward signals that drive model and agent quality.

Most model evaluation stops at a scorecard. The failing traces get thrown away, even though they're the most relevant training signal we have. Our team puts them to work. We evaluate across offline benchmarks, device-in-the-loop simulation, and on-device observation in production, and we turn what we find into persona-grounded datasets and reward signals for foundation model post-training. In this role, you will build the systems that connect failure analysis to measurable model and agent improvements across a broad range of AI products at Apple.