- Master's or Ph.D. in Computer Science, Artificial Intelligence, or equivalent experience.
- 8+ years of hands-on experience in a technical AI role, with a strong emphasis on Gen AI.
- Proficient in the latest and greatest model architectures and be able to articulate the computational complexities of each.
- Proven track record of deploying and optimizing LLM models for inference in production environments using well known inferencing engines e.g., vLLM, TRT-LLM, SGLang, etc.
- Expertise in training and fine-tuning LLMs using popular frameworks such as TensorFlow, PyTorch, or Hugging Face Transformers.
- Solid understanding of GPU cluster architecture and the ability to bring to bear parallel processing for accelerated model training and inference.
- Experience with basic DevOps tools e.g., Docker, Kubernetes, GitLab, Linux Command Line, Shell, etc.
- Excellent communication and teamwork skills with the ability to explain complex technical concepts to both technical and non-technical collaborators.
- Experience leading workshops, training sessions, and presenting technical solutions to diverse audiences.
Ways To Stand Out From The Crowd
- Experience with Agentic AI frameworks, tools, and protocols e.g., LangChain, LangGraph, MCP.
- Understand Multimodal LLMs, VLMs, etc.
- Experience in deploying LLM models at scale on mainstream cloud providers (e.g., AWS, Azure, GCP).
- Proven track record to profile and optimize inference latency and throughput, memory and I/O utilization.
- Mathematical understanding of different parallelisation techniques in Gen AI
Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary range for this position is 184,000 USD – 287,500 USD.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until November 3, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.