Senior Staff Inference Performance Engineer
d-Matrix, Santa Clara +1
What you will do
- Diagnose performance problems across the full serving path, from orchestration (scheduling, placement, networking, autoscaling) to inference internals (batching, KV-cache, prefill/decode, serving framework, driver and runtime, interconnect, host OS and NUMA, accelerator).
- Isolate each problem to a specific layer and owner, then decide whether to fix it directly, route it to the owning team, or both, with a workaround now and a tracked handoff for the permanent fix.