ML Model Serving Engineer

Sesame, San Francisco +2

What you will do

Turbocharge our serving layer, consisting of a variety of LLM, speech, and vision models.
Partner with ML infrastructure and training engineers to build a fast, cost-effective, accurate, and reliable serving layer to power a new consumer product category.
Modify and extend LLM serving frameworks like VLLM and SGLang to take advantage of the latest techniques in high-performance model serving.
Work with the training team to identify opportunities to produce faster models without sacrificing quality.

Sesame, San Francisco +2

$175K–$280K

a year

This base pay is below the median for inference and ML systems jobs in the Bay Area with no level in the job title.

We compare the middle of each posted range. This is base pay as posted. The group does not include this job.

The Sesame site opens in a new tab.

Funding records can have errors and can be missing. The company page has the links.

Compare your résumé with this job. See where you match, what is missing and which lines to change.

Turbocharge our serving layer, consisting of a variety of LLM, speech, and vision models.
Partner with ML infrastructure and training engineers to build a fast, cost-effective, accurate, and reliable serving layer to power a new consumer product category.
Modify and extend LLM serving frameworks like VLLM and SGLang to take advantage of the latest techniques in high-performance model serving.
Work with the training team to identify opportunities to produce faster models without sacrificing quality.