- 12+ years of experience architecting datacenter-scale AI, HPC, or storage infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent.
- Bachelors in Computer Science or related field (or equivalent experience).
- Deep expertise in AI infrastructure build, including disaggregated inference architectures, LLM training pipelines, and autonomous AI system patterns.
- Hands-on experience with RDMA (RoCEv2/InfiniBand), high-performance storage protocols (NVMeoF, GPFS, Lustre, or S3-compatible object storage), and low-latency fabric design.
- Strong understanding of KV Cache management strategies, including tiered memory/storage hierarchies for inference optimization.
- Familiarity with Retrieval-Augmented Generation (RAG) architectures and the storage, indexing, and retrieval patterns they demand at scale.
- Experience with NVIDIA DOCA or equivalent DPU/SmartNIC programming frameworks for offloading data plane and storage services.
- Proven foundation in networking: Spectrum-X Ethernet, InfiniBand, NVLink Switch fabrics, congestion control, and datacenter topologies.
Ways to stand out from the crowd
- Proven experience designing reference architectures jointly with storage or infrastructure OEM partners (e.g., NetApp, DDN, VAST, Pure Storage, Dell or similar).
- Hands-on deployment experience with disaggregated inference systems, including prefill/decode separation, KV Cache offload, and request routing.
- Deep familiarity with NVIDIA Grace-Hopper, Grace-Blackwell, or upcoming Vera-Rubin platforms and their system-level implications for AI workloads.
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you!
Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary range for this position is 224,000 USD – 356,500 USD.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until November 3, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.