Inference Engineering and Product Lead

Modal's LLM inference platform delivers frontier performance https://modal.com/blog/kimi-k3-by-moonshot-now-available-on-modal for open-source models with best-in-class elasticity and developer experience, made in part possible by our custom runtime with GPU memory snapshots https://modal.com/blog/gpu-mem-snapshots and multi-cloud substrate https://modal.com/blog/resource-solver.

We're looking for a leader to own the direction and execution of this platform to continue to establish us as the clear market leader, working closely with customers like Cognition, Doordash, Ramp, and many more. You'll be leading a group of highly talented engineers working on our market-leading LLM inference offering, spanning the serving stack, routing infrastructure, internal agentic optimization platform, and the user-facing product surface area.