FriendliAI, San Francisco
FriendliAI is looking for a Cloud Infrastructure Engineer to own the architecture and evolution of the cluster platform behind our GPU-accelerated AI inference cloud. As a Software Engineer, Cloud Infrastructure, you will design how our clusters are built and connected, extend Kubernetes where its defaults fall short, and own the network path that inference traffic depends on.
Inference is an unforgiving workload for Kubernetes. Traffic is bursty and latency-sensitive, GPU capacity is scarce and inelastic, tenants must stay isolated, and multi-node serving depends on the network holding up under sustained load. This is a hands-on architecture role for an engineer who has already run large clusters in production and wants to push them further.
FriendliAI is the fastest inference cloud for agents, built to run frontier open-weight models in production at scale. It delivers up to 7x faster output token speed, up to 90% lower inference costs, and 99.99% uptime across the most demanding agent workloads — long-context inference, real-time streaming, and accurate tool calling.
We are a small, fast-moving team doing work that matters at one of the most exciting moments in the history of technology. With our world-class inference stack, we are building the platform teams can actually rely on.
OpenAISan Francisco
$255K–$490K / yr
Posted Sep 16, 2026
FalSan Francisco
$180K–$250K / yr
Posted Jul 21, 2025
Together AISan Francisco
$190K–$270K / yr
Posted May 15, 2026
Together AIIndia +1
Pay not posted
Posted Aug 19, 2026
Together AIBangalore, India +1
Pay not posted
Posted Jul 13, 2026
ClineSan Francisco
$225K–$250K / yr
Posted Jul 29, 2025
Source: the FriendliAI Ashby job board. We last checked this job 2 h ago. We first saw it 4 days ago. A job on a job board does not always mean that the team interviews people now. We found this job board in a public list. We did not yet compare it with the careers page of the company.