GPU Performance Engineer
Genmo, San Francisco HQ
The role
We're seeking a GPU Performance Engineer to squeeze every last FLOP from our H100 infrastructure and optimize our model serving stack to its absolute limits.
You'll be our performance optimization expert, using advanced profiling tools to identify bottlenecks and implementing solutions that achieve 5-10x speedups. From writing custom CUDA kernels to eliminating cold start latency, you'll ensure our infrastructure delivers world-class performance. This role is perfect for someone who gets excited about microsecond optimizations and pushing hardware to its theoretical limits.
What you will do
- Profile and optimize GPU workloads using Nsight Systems, nvprof, and custom instrumentation
- Write high-performance CUDA and Triton kernels for critical model operations
- Optimize cold start latency from seconds to milliseconds for our serving infrastructure
- Tune memory access patterns, kernel fusion, and GPU utilization
- Collaborate with ML engineers to optimize model implementations