Research Engineer, Inference Foundation
Mistral AI, Munich +2
The role
The Inference Foundation team owns the core of Mistral's inference stack: the inference engine and its orchestration, from the feature set and configuration that serve our models in production to the release machinery that keeps the stack current and production-grade.
This is a hybrid position spanning production LLM serving, engine and platform development, and capacity engineering. You will work on three intertwined problems: