As the technical lead for inference performance, you will own end-to-end responsibility for the platform's Token Performance. For models ranging from hundreds of billions to trillions of parameters (including MoE), you will continuously reduce cost per million tokens and increase per-GPU Goodput while meeting TTFT/TPOT SLOs, and prove the gain from every optimization with reproducible data.
Zenlayer is the first massively distributed edge cloud provider, operating 290+ Points of Presence across 70+ countries. With accolades including PTC “Best Networking Innovation”, “Outstanding Cloud, Data Center, or Interconnection Company”, and Inc. 5000, we enable businesses to deploy and run applications at the edge, thus reducing network latency to the end user. Zenlayer focuses on improving connections worldwide, all while nurturing a unique company culture that values service, growth, and trust.
As a “Zenplayer”, you’ll be joining a community of success-driven team players that share the dream of powering a better-connected world.
NebiusAmsterdam, Netherlands +6
Pay not posted
Posted 26 days ago
NVIDIAUS, CA, Santa Clara
$184K–$357K / yr
Posted 17 days ago
$220K–$320K / yr
Posted Jan 21, 2026
$200K–$300K / yr
Posted May 1, 2026
IncoBay Area HQ +1
$200K–$350K / yr
Posted Jul 22, 2026
Hippocratic AIMenlo Park, CA
Pay not posted
Posted Oct 7, 2026
Source: the company job board. We last checked this job 47 min ago. We first saw it 47 min ago. A job on a job board does not always mean that the team interviews people now. We found this job board in a public list. We did not yet compare it with the careers page of the company.
No one has reported an interview at Zenlayer yet. Did you interview there? Add the questions.
This base pay is above the median for staff inference and ML systems jobs in the US.
We compare the middle of each posted range. This is base pay as posted. The group does not include this job.