Senior Software Engineer, Bulk/Interactive Inference
Waymo, Mountain View, CA +1
The role
In this hybrid role, you will report to the Head of ML Platform- Senior Staff Software Engineer.
What you will do
- Develop Waymo's inference platform to make it scalable, high throughput, and low latency
- Work closely with other teams across Waymo in hosting both internal and external ML models, including LLMs
- Improving the efficiency of running inference on these large models to increase throughput and save cost
- Deploy and integrate model inference solutions across a variety of use cases, such as distillation, eval, dataset generation, active learning, and auto-labeling