Software Engineer, ML Performance

NVIDIA, US, CA, Santa Clara +1

The role

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent.

As an NVIDIAN, you’ll be immersed in an inclusive, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

Join us at NVIDIA and be part of a team that’s crafting the future of technology! Our dedication to innovation and excellence has made us a leader in computer graphics, PC gaming, and accelerated computing for over 25 years. As we delve into the limitless opportunities that AI brings, we are looking for passionate individuals to help us push boundaries and redefine what's possible. NVIDIA is seeking a dedicated Software Engineer, ML Performance to join our team in Santa Clara, CA.

All jobs

Software Engineer, ML Performance

NVIDIA, US, CA, Santa Clara +1

The role

What you need

Bachelor’s degree in Computer Science, Computer Engineering, or a related field, or equivalent experience.
12+ years of relevant software engineering experience, including hands-on optimization of GPU training or inference workloads in production.
Demonstrated performance work across more than one layer of the stack, with a clear account of the baseline, evidence, alternative explanations and validated outcome.
Experience diagnosing performance across many jobs, machines or tenants, not only tuning a single workload.
Enough familiarity with framework, runtime and compiler interfaces to say where a signal should be measured, even when someone else writes the instrumentation.
Ability to distinguish symptoms from causes, recognize noisy or incomplete measurements and the effects of the measurement itself, and know when the evidence is insufficient.
Strong programming and debugging skills, demonstrated by maintainable analysis code, tests or repeatable investigation procedures, including when using automated development tools.
Clear communication of findings, trade-offs and remaining uncertainty to the people who own the workload.
Proficiency with Python and CUDA.

Ways to stand out from the crowd

Improved operation of both training and inference.
Deep knowledge of one or more of PyTorch, JAX, Megatron, NCCL, TensorRT-LLM, vLLM, SGLang or Dynamo.
Experience moving between application, system software, driver or hardware roles, and the full-stack view that comes with it.
Statistical judgment applied to noisy, multi-node fleet-scale performance data. Ideally, experience with counter-factual analysis and segmentation of workloads for diagnosing regressions.
Built debugging or performance-analysis tools used by other engineers, with evidence that they made investigations more effective.

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary range for this position is 224,000 USD – 356,500 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 3, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

Software Engineer, ML Performance

The role

Software Engineer, ML Performance

The role

What you will do

What you need

Ways to stand out from the crowd

Similar jobs at other companies

Lead Software Systems Engineer - GPU Performance

Staff AI Performance Engineer

GPU Architecture and AI Performance Simulation Engineer

Senior GPU Performance Engineer - AI Workloads

Senior Software Engineer - Model Performance

Performance Engineer (Inference, Training & GPU)

NVIDIA