ML Engineer, Inference Optimization
Build, San Francisco
The role
Inference is about 90% of compute spend. Economics are heavily driven by inference optimization. We’re hiring someone to make inference cheaper, faster, and good enough that we can scale the data engine and the product without the GPU bill eating the company.
What you will do
- Own inference performance: latency, throughput, and cost per unit of work (tokens, frames, or jobs)