Senior/Staff Software Engineer, Distributed Systems

We’re looking for a Senior or Staff Software Engineer with deep experience building and operating distributed production systems.

You’ll work on the infrastructure underlying Hedra’s inference platform: systems that schedule and route compute, serve models efficiently, handle high-throughput workloads, and remain reliable as both traffic and the number of models we support grow.

The problems are often ambiguous and don’t have obvious answers. We’re looking for someone who can reason from first principles, identify bottlenecks and failure modes before they become problems, and make thoughtful tradeoffs across performance, reliability, complexity, and cost.