Software Engineer, Model Routing & Inference
Cursor, New York, NY +1
The role
As a Software Engineer on the Model Routing & Inference team at SpaceXSI, you'll build the inference platform that powers every AI interaction in the product. This team owns the full inference path: making Cursor's AI faster, more reliable, and more cost-effective at a scale few teams in the world get to operate at. Every agent session, every tab completion, and every chat message flows through your stack.
What you will do
- Build and evolve our inference gateway, a single abstraction over every provider's API semantics, so model onboarding becomes a config change
- Design intelligent cross-provider failover so no single provider outage causes user-visible degradation
- Design routing backpressure and admission control so traffic spikes don't cascade into providers
What you need
Basic qualifications
- Experience building high-throughput, low-latency distributed systems (e.g., inference serving, traffic routing, or real-time data pipelines)