Senior Software Engineer, CUTLASS Performance

NVIDIA, US, CA, Santa Clara +4

What you will do

Benchmark the performance of state-of-the-art deep learning models’ inference and training passes to identify key GPU kernel and fusion opportunities.
Identify gaps between theoretical and realized performance, and suggest software improvements or model adjustments to resolve them.
Develop tooling to automate the benchmarking, analysis, and performance optimization loop to push the limit of CUTLASS kernel performance within DL networks.
Be the authoritative resource on kernel performance in the team and engage with teams across NVIDIA including GPU architecture, DL frameworks, and QA as the performance representative for the CUTLASS team.

NVIDIA, US, CA, Santa Clara +4

$152K–$288K

a year

This base pay is near the median for senior software engineering jobs in the Bay Area.

We compare the middle of each posted range. This is base pay as posted. The group does not include this job.

The NVIDIA site opens in a new tab.

See total pay at Nvidia on Levels.fyiBase, stock and bonus, as employees report it.

Compare your résumé with this job. See where you match, what is missing and which lines to change.

Benchmark the performance of state-of-the-art deep learning models’ inference and training passes to identify key GPU kernel and fusion opportunities.
Identify gaps between theoretical and realized performance, and suggest software improvements or model adjustments to resolve them.
Develop tooling to automate the benchmarking, analysis, and performance optimization loop to push the limit of CUTLASS kernel performance within DL networks.
Be the authoritative resource on kernel performance in the team and engage with teams across NVIDIA including GPU architecture, DL frameworks, and QA as the performance representative for the CUTLASS team.