Research Engineer - Language Model Pre-Training
Zyphra, San Francisco
The role
As a Research Engineer – Language Model Pre-Training, you'll shape our language model roadmap through end-to-end pretraining development. You will work extremely closely with our pretraining team, who will integrate your insights into our next-generation models.
What you will do
- Large-scale training runs and model parallelization
- Performance optimization of our pretraining stack
- Dataset collection, processing, and evaluation