Jobs Ask AI Pay Interviews Companies CompareSign in

Wait…

We read every job from the company's own job board. You apply on the company site.Jobs Job types Internships New graduate jobs Companies Pay Reported pay Check an offer Add your pay Interview questions Add your interview questions Compare with LinkedIn Job sites compared Pay transparency laws API for developers Monthly report Companies we cover Make a portfolio page For companies: find people About Privacy

Senior Product Manager - AI Platform Inference

NVIDIA, US, CA, Santa Clara

Posted pay

$168K–$328K

a year

Location: US, CA, Santa Clara
Work type: Not given
Level: Senior
Experience: 6+ years
Skills in the job text: vLLM
Posted: 15 days ago
Last check: 4 days ago
Job type: Product management

Apply on the NVIDIA site Make a résumé and a cover letter for this job Sign in to save

The NVIDIA site opens in a new tab.

N

NVIDIA

About NVIDIA: funding, hiring and pay

Check my fit

Compare your résumé with this job. See where you match, what is missing and which lines to change.

Sign in to check your fit

Make a résumé and a cover letter for this job

Paste your résumé, or use the résumé on your profile.
Get the résumé as a PDF and the letter as text. We use only the facts in your résumé.
Apply on the NVIDIA site.

Open the apply kit

The role

Inference is the fastest growing and most competitive area in Generative AI today. It is where AI models impact our daily life, and where ever bit of accuracy and performance matters for quality, safety, and cost. Inference is also constantly evolving, with new acceleration algorithms, usecases, and deployment techniques. As a Senior Product Manager for AI Platform Inference you will be responsible for building the tools, SDKs, and libraries which enables developers' Inference deployments to thrive on NVIDIA GPUs.

As NVIDIA Product Managers, our goal is to enable developers to be successful on the NVIDIA Platform, and push the boundaries of what is possible with their AI deployments! For Inference, we are the champions inside NVIDIA for AI developers looking to accelerate their deployments on GPUs. We work directly with developers inside and outside of the company to identify key improvements, create roadmaps, and stay alert on the inference landscape.

We also work with NVIDIA leaders to define clear product strategy, and marketing team teams to build go-to-market plans. The Product Management organization at NVIDIA is a small, strong, and impactful group. We focus on enabling deep learning across all GPU use cases and providing great solutions for developers. We are seeking a rare blend of product skills, technical depth, and passion to make NVIDIA great for developers. Does that sounds familiar?

If so, we would love to hear from you!

What you will do

Create products to help developers build better Inference deployments
Develop product strategy, roadmaps, and go-to-market plans
Collaborate with internal and external developers to build product-based roadmaps for model optimization software
Work with leadership to align with and drive company strategy

What you need

Experience with Inference deployment and optimization software (ex. vLLM, SGLang, FlashInfer, TensorRT-LLM, Triton, Dynamo, TorchAO, etc.)
Demonstrable knowledge of GenAI or machine learning concepts, particularly around performance optimization, and software development and delivery
BS or MS degree in Computer Science, Computer Engineering, or similar experience (or equivalent experience)
6+ years of technical product management, or similar, experience at a technology company
Strong communication and interpersonal skills

Ways to stand out from the crowd

Experience leading optimization products for Inference
Working on Open Source & Github-first developer products with deep customer interactions
Knowledge of GPU architecture, HW/SW co-design, and performance profiling

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are: 168,000 USD – 258,750 USD for Level 4; and 208,000 USD – 327,750 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 3, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

Legal notes

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Read the job posting on the NVIDIA site

Similar jobs at other companies

Inference Performance Engineer, Agent Driven Inference Optimization
NVIDIAUS, CA, Santa Clara +1
- Hybrid
- Inference & ML systems
$124K–$242K / yr
Posted 5 days ago
checked 4 days ago
Senior Technical Product Manager - Inference Platform
NebiusAmsterdam, Netherlands +3
- Senior
- Remote
- Product management
Pay not posted
Posted Jul 15, 2026
Senior AI Infrastructure Engineer - DGX Cloud
NVIDIARemote - US
- Senior
- Remote
- ML / AI engineering
$152K–$288K / yr
Posted 4 days ago
checked 4 days ago
Senior Product Manager - Inference Platform
NebiusRemote - United States +1
- Senior
- Remote
- Product management
$228K–$285K / yr
Posted Aug 5, 2026
Lead Product Manager, Inference
Mistral AIParis +2
- Senior
- Hybrid
- Product management
Pay not posted
Posted Sep 29, 2026
Senior Software Engineer, Datacenter Automation Platforms
NVIDIAUS, CA, Santa Clara
- Senior
- Hybrid
- Software engineering
$184K–$357K / yr
Posted 4 days ago
checked 4 days ago

Source: the NVIDIA Workday careers site. We last checked this job 4 days ago. We first saw it 5 days ago. A job on a job board does not always mean that the team interviews people now.

Interview questions

No one has reported an interview at NVIDIA yet. Did you interview there? Add the questions.

See total pay at Nvidia on Levels.fyiBase, stock and bonus, as employees report it.

NVIDIA

Open tech jobs: 1,424
With posted pay: 78%
Median posted base: $184K–$322K

About NVIDIA: funding, hiring and pay

Compared with similar jobs

This base pay is above the median for senior product management jobs in the Bay Area.

Median: $210K a year
Other jobs in the group: 471

We compare the middle of each posted range. This is base pay as posted. The group does not include this job.