Sr. Product Manager, Technical, Amazon Selection and Catalog Systems

Amazon is seeking a Senior Product Manager – Technical to own the vision and roadmap for MARS (Model Accelerator and Recommender Service), our hardware-agnostic platform for optimizing, benchmarking, and containerizing large language models across heterogeneous compute (Inferentia2, Trainium, and GPU). MARS automatically tunes and recommends optimal hosting configurations, delivering substantial inference cost reduction, throughput gains, and accelerator-utilization improvements for teams across the organization—from model hosting and catalog enrichment to search ranking.

In this role, you will work backwards from internal customers to define a multi-year product strategy that scales MARS into a shared, self-service optimization platform. You will partner closely with science and engineering to expand the platform's capabilities—new hardware backends, quantization and distillation techniques, and automated benchmarking—while establishing the operating model, intake, and prioritization framework needed to grow adoption. You will own key business metrics such as cost per million tokens, accelerator utilization, and realized IMR savings, and communicate progress and trade-offs to senior leadership.