- Masters or PhD in Computer Science, Computer Engineering, or related field or equivalent experience.
- 6+ years of relevant work or research experience in compilers, distributed systems, or deep learning training.
- Compiler design and implementation.
- Distributed system design, development, and deployment.
- Experience with deep learning frameworks (JAX, PyTorch).
- GPU training and inference of deep learning models.
- C/C++ and Python programming, with excellent software design skills, including debugging, performance analysis, and test design.
- Experience with parallel computing libraries (MPI).
- Be able to work independently, define project goals and scope, and lead your own development efforts.
- Strong communication skills are required, including working directly with engineers at partner companies to debug and tune large training runs, along with the ability to work in a dynamic product-oriented team.
Ways to stand out from the crowd
- Experience with JAX internals (jaxpr, tracing, sharding, shard_map), or with XLA, StableHLO, or MLIR.
- Experience building or tuning large training jobs with pipeline, tensor, expert, and data parallelism, for example in MaxText or Megatron-LM, and debugging their performance on large GPU clusters.
- Knowledge of GPU communication libraries such as NCCL, NVSHMEM, or RDMA, and of CPU and/or GPU architecture. CUDA programming experience is a plus.
- Contributions to open-source compiler or machine learning projects.
- Experience in mentoring early career engineers and interns is a bonus.
With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.
Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary range for this position is 184,000 USD – 287,500 USD.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until November 6, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
#deeplearning
