Member of Technical Staff, AMD GPU Kernel Engineering
Inferact, Singapore
The role
We're looking for an AMD GPU kernel engineer to make vLLM a first-class inference engine across the AMD accelerator ecosystem. A large part of this role is designing, writing, and optimizing kernels for AMD GPUs in HIP, Triton, CK, and AITER, for attention, GEMM, sampling, KV cache, and communication-heavy operations.
You'll work at the boundary of kernels, compilers, inference systems, and hardware architecture. You'll profile production-relevant models on AMD GPUs, find the bottleneck, and write the kernel that removes it, with clear correctness, latency, and throughput benchmarks. Your work will help make AMD GPU support in vLLM usable, fast, benchmarked, and maintainable.