System Software Architect, AI Hardware and Software Performance

NVIDIA, China, Shanghai

The role

We are looking for a System Software Architect to set the technical direction for these platforms. You will build platform components and lead projects from problem discovery and technical design through production deployment and adoption. This hands-on role combines architecture, cross-team alignment, and direct system debugging. You will collaborate with NVIDIA teams around the world and help shape how NVIDIA measures, understands, and improves performance for large language models, agentic AI, and emerging HPC and AI workloads.

What you will do

What you need

M.Sc. or Ph.D. in Computer Science, Electrical or Computer Engineering from a leading university (or equivalent experience).
10+ years of hands-on experience in developing system software, distributed systems, or AI systems.
Strong Python and software engineering expertise, with a track record of building and operating production-quality tools, services, or automation frameworks.
Proven technical leadership on sophisticated, multi-functional projects, including defining architecture, managing technical risk, resolving ambiguity, and driving solutions through delivery and adoption.
Experience in quantitative analysis of AI hardware and systems, including hardware and system performance, architecture evaluation and power efficiency.
Experience in operating distributed or cloud-native systems at scale, including performance profiling, capacity analysis, or resource scheduling.
Excellent communication, influence, presentation, and cross-functional coordination skills, with experience aligning teams across countries and time zones to drive decisions.
A record of mentoring engineers, raising engineering quality, and helping teams make better technical decisions.

Ways to Stand Out From the Crowd

Good technical understanding of modern compute hardware at one or more levels of the stack, including silicon, systems, networking, or clusters.
Working knowledge of how AI workloads stress hardware, including memory bandwidth, memory capacity, interconnect communication, and real-world compute utilization.
Practical experience building custom agent harnesses or strategies that improve workflows at team or organizational scale.
Hands-on experience with AI training or inference frameworks such as vLLM, SGLang, TensorRT-LLM, PyTorch, or JAX.
Demonstrated success turning loosely defined, cross-organizational problems into durable platforms or programs with measurable engineering impact.

We have some of the most forward-thinking and hardworking people in the world working for us. If you are creative, autonomous, and passionate about providing technical leadership while remaining hands-on in building systems that make complex AI performance work repeatable and scalable, we want to hear from you.

System Software Architect, AI Hardware and Software Performance

The role

What you will do

System Software Architect, AI Hardware and Software Performance

The role

What you will do

What you need

Ways to Stand Out From the Crowd

About NVIDIA

Similar jobs at other companies

Principal Engineer - Perf and Benchmarking

Senior Software Engineer, Datacenter Automation Platforms

Inference Performance Engineer, Agent Driven Inference Optimization

AI Compute Engineer

Lead Software Systems Engineer - GPU Performance

Staff AI Performance Engineer

NVIDIA