Staff Engineer, Inference Optimizations

DigitalOcean has this job in 4 other places

The role

DigitalOcean is seeking a Senior Engineer 2 to play a key technical role in our AI Inference Optimization team. DigitalOcean aims to be the Inference Cloud of choice for digitally native companies and you will help ensure we can offer the industry-leading performance for our inference services. You will be responsible for the architectural decisions that maximize throughput and minimize latency for the world’s most advanced large models.

All jobs

Staff Engineer, Inference Optimizations

DigitalOcean, Austin +1

DigitalOcean has this job in 4 other places

Posted pay

$191K–$239K

a year

Compared with similar jobs

This base pay is below the median for staff inference and ML systems jobs in the US.

Median: $254K a year
Other jobs in the group: 65

We compare the middle of each posted range. This is base pay as posted. The group does not include this job.

Location: Austin +1
Work type: Not given
Level: Staff
Experience: 5+ years
Skills in the job text: CUDA
Posted: Jul 23, 2026
Last check: 5 h ago
Job type: Inference & ML systems, ML / AI engineering

Apply on the DigitalOcean site Sign in to save

The DigitalOcean site opens in a new tab.

DigitalOcean

Open tech jobs: 54
With posted pay: 69%
Median posted base: $175K–$215K

About DigitalOcean: funding, hiring and pay

DigitalOcean

About DigitalOcean: funding, hiring and pay

Check my fit

Compare your résumé with this job. See where you match, what is missing and which lines to change.

The role

Why You’ll Like Working for DigitalOcean

We innovate with purpose. You’ll be a part of a cutting-edge technology company with a high-growth trajectory, who are proud to simplify cloud and AI so builders can spend more time creating software that changes the world. As part of our team, you’ll embody our "Shark" mindset: bold, ambitious, and scrappy. You'll lead with a bias for action and take true ownership of our products, customer success, and team culture.
We prioritize career development. At DigitalOcean, you’ll do the best work of your career. You will join a community of exceptional talent, collaborating closely with some of the brightest and most interesting people in the industry. We are a high-performance and fast-paced organization that will always challenge you to think big. Our talent development team prioritizes your professional development and provides resources to support your growth. We provide employees with reimbursement for relevant conferences, training, and education, subject to company policy.
We care about your well-being. We take a comprehensive approach to our total rewards packages because we know different things drive different people. Our benefits are designed to support you and may include flexible time off, local team meetups, and mental health and well being support. Our benefits philosophy is consistent globally, but specific benefits and eligibility vary by location to reflect local needs and regulations.
We reward our employees. The salary range for this position is based on market data, relevant years of experience, and skills. Eligible employees may also receive equity compensation, which may include a new hire equity grant and, in participating countries, the opportunity to participate in our Employee Stock Purchase Program. Equity awards are subject to approval and the terms of the applicable plan.
Non-sales roles: In addition to base salary, this role is eligible to participate in DigitalOcean’s annual bonus plan and may be eligible for a new hire equity grant, subject to plan terms and local eligibility. Bonus amounts depend on company and individual performance.
Sales roles (sales compensation eligible): In addition to base salary, this role may be eligible to earn incentive compensation under the applicable sales compensation plan and may be eligible for a new hire equity grant, subject to plan terms and local eligibility.
DigitalOcean is an equal-opportunity employer. We do not discriminate on the basis of race, sex, disability, protected veteran status, or any other characteristic protected by applicable law.

Application Limit: You may apply to a maximum of 3 positions within any 180-day period. This policy promotes better role-candidate matching and encourages thoughtful applications where your qualifications align most strongly.

Staff Engineer, Inference Optimizations

The role

Staff Engineer, Inference Optimizations

The role

What you will do

What you need

Why You’ll Like Working for DigitalOcean

Pay and benefits

About DigitalOcean

Similar jobs at other companies

Senior Software Engineer - Model Performance

Machine Learning Engineer — Inference Optimization

Inference Performance Engineer, Agent Driven Inference Optimization

Software Engineer, TPU Compilers

AI Researcher — Inference Optimization

Senior Inference Engineer

DigitalOcean

Compared with similar jobs