Agentic AI Systems Evaluation Engineer

We are looking for a Systems Evaluation Engineer to continuously assess whether our AI software delivers the customer experiences and system performance it is designed to achieve. You will connect user stories and product goals to measurable outcomes, develop evaluation methodologies, and interpret results throughout development.

Working closely with product, architecture, and engineering teams, you will evaluate AI workloads, compare model and runtime implementations, and explain how technical performance affects the customer experience. Your findings will help teams understand trade-offs, identify gaps, and make better design and implementation decisions.

This role requires deep technical understanding of AI inference and PC systems, combined with strong analytical judgment. You will own the evaluation approach and interpretation of evidence, providing continuous feedback that shapes the developing solution.