Software Dev Engineer II, SageMaker Compute Governance

Training and running large AI models takes enormous amounts of expensive accelerated compute, and most of it sits idle. Across the industry, a large share of GPU capacity is paid for but never does useful work because jobs cannot find it, cannot share it, or cannot see it and use it efficiently. We build the services that closes that gap.

We are looking for a Software Development Engineer to help build the systems that put idle or inefficiently used GPUs to work. You will design and build distributed backend services that let organizations pool capacity across many clusters and accounts, route it to the workloads that need it most, and see exactly how it is being used. This is deep systems work at the intersection of large-scale distributed systems, container orchestration, and cloud infrastructure, and it directly changes how much value customers get from every GPU they pay for.