Research Engineer - Tokenizer & Protocols
Mistral AI, Paris
The role
Between a conversation and a model sit the formats and tokenizers that every part of our stack relies on. You will help own them, and the tooling around them, so that training, evaluation and production all speak exactly the same language.
You will work across the entire stack, spanning pretraining, post-training and deployment, and your decisions will reach every model we ship.
What you will do
- Design, build and maintain core libraries for tokenization and model interfaces.
- Evolve our formats and tokenizers as models and use cases change.