Search tech jobs | JobsWithPay

Jobs Ask AI Pay Interviews Companies CompareSign in

The jobs load…

We read every job from the company's own job board. You apply on the company site.Jobs Job types Internships New graduate jobs Companies Pay Reported pay Check an offer Add your pay Interview questions Add your interview questions Compare with LinkedIn Job sites compared Pay transparency laws API for developers Monthly report Companies we cover Make a portfolio page For companies: find people About Privacy

Filters

Job typeSoftware engineering8ML / AI engineering265Inference & ML systems305Research32Product management21Solutions engineering3Hardware and robotics1

LocationBay Area211New York38Remote (US)32Other places in the US61Remote (all countries)1Outside the US92India8Bengaluru7Mumbai1Chennai1Remote (India)1

LevelIntern11Entry level7Senior75Staff51Principal8Director+6

Work typeOnsite80Hybrid59Remote35

Minimum base payNo minimum$100K+190$150K+189$200K+176$250K+143$300K+104

Date postedAll datesLast 24 hours0Last 7 days15Last 30 days87

Years of experience0 to 2 years3 to 5 years6 to 9 years10 years or more

SkillsPythonAWSSQLTypeScriptKubernetesGCPAzureReactDockerJavaGoC++RustTerraformPyTorchSparkPostgreSQLJavaScriptNode.jsSwiftFigmaExcel

Other filtersOnly AI and ML jobsPosted payVisa sponsorship in the job textMember of Technical StaffOnly manager jobsHide jobs that we found on LinkedIn

335 jobs from 7,835 companies, checked on their job boards 5 h ago

Sort

“Inference”×Remove all filters

Email me new jobs like this

Tech jobs. With the words “inference”.

Your email address

Website

One email each day, only when there are new jobs. No account is necessary. You can stop the emails with one click.

M
Member of Technical Staff, Inference
MirendilSan Francisco
- Onsite
- Inference & ML systems
- Member of Technical Staff
$300K–$400K / yr
Posted Jun 24, 2026
I
Member of Technical Staff, Performance and Scale
InferactSingapore
- Onsite
- Inference & ML systems
- Member of Technical Staff
- Visa sponsorship in the job text
- Go
- C++
- Rust
SGD 200K–SGD 400K / yr
Posted Jun 24, 2026
I
Member of Technical Staff, Inference
InferactSingapore
- Onsite
- Inference & ML systems
- Member of Technical Staff
- Visa sponsorship in the job text

Python
PyTorch
vLLM

SGD 200K–SGD 400K / yr

Posted Jun 24, 2026

I

Member of Technical Staff, Cloud Orchestration

InferactSingapore

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Python
AWS
Kubernetes
GCP
Azure
+5 more

SGD 200K–SGD 400K / yr

Posted Jun 24, 2026

ML Engineer, Inference & Optimization

PikaUS remote

Remote
Inference & ML systems
5+ years

CUDA

Pay not posted

Posted Jun 23, 2026

Software Engineer, Inference Platform

Cerebras SystemsSunnyvale, CA +1

Onsite
Inference & ML systems
3+ years

Kubernetes
Go
C++

Pay not posted

Posted Jun 20, 2026

Staff Software Engineer, Inference Platform

Cerebras SystemsSunnyvale, CA +1

Staff
Onsite
Inference & ML systems
8+ years

Kubernetes
Go
C++

Pay not posted

Posted Jun 19, 2026

I

Member of Technical Staff, Inference

InferactSan Francisco

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Python
PyTorch
vLLM

$200K–$400K / yr

Posted Jun 18, 2026

I

Member of Technical Staff, TPU Kernel Engineering

InferactSan Francisco

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

PyTorch
CUDA
JAX
vLLM

$200K–$400K / yr

Posted Jun 17, 2026

Sr. Software Engineer, Inference

CoreWeave EuropeWarsaw, Poland +1

Senior
Inference & ML systems
3+ years

Python
Kubernetes
Go
C++
CUDA
+4 more

Pay not posted

Posted Jun 15, 2026

Member of Technical Staff, Inference

Radical NumericsSan Francisco

Inference & ML systems
Member of Technical Staff

Python
PyTorch
CUDA
vLLM

Pay not posted

Posted Jun 15, 2026

Staff+ Software Engineer, Inference Velocity

AnthropicRemote-Friendly (Travel-Required) +3

Staff
Remote
Inference & ML systems
8+ years
Visa sponsorship in the job text

AWS
CUDA

$405K–$485K / yr

Posted Jun 12, 2026

NL

Member of Technical Staff — Model Optimization and Inference (New Grad)

Nuance LabsSeattle, Washington +1

Entry level
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Python
PyTorch
CUDA
vLLM

$200K–$300K / yr

Posted Jun 11, 2026

Staff + Senior Software Engineer, Inference Infrastructure

AnthropicSan Francisco, CA +2

Staff
Inference & ML systems
Visa sponsorship in the job text

Python
AWS
Kubernetes
GCP
Azure
+1 more

$320K–$485K / yr

Posted Jun 8, 2026

NL

Member of Technical Staff — Model Optimization and Inference (Experienced)

Nuance LabsSeattle, Washington +1

Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Python
PyTorch
CUDA
vLLM

$250K–$350K / yr

Posted Jun 5, 2026

ML Engineer - Inference & Model Deployment

HiringCafeCupertino

Onsite
Inference & ML systems

vLLM

$250K–$310K / yr

Posted Jun 5, 2026

Inference Systems Engineer: Linux Kernel Test and Validation

CedanaRemote (US)

Remote
Inference & ML systems
5+ years

Kubernetes
Linux
vLLM

$180K / yr

Posted Jun 3, 2026

checked 2 days ago

Senior Director of Engineering - Inference Serving

SambaNovaSan Jose, California +1

Director+
Inference & ML systems
Manager
12+ years

Python
Kubernetes
Go
Rust

$245K–$325K / yr

Posted Jun 3, 2026

AI Research Engineer, Inference

Hudson River TradingLondon, United Kingdom +2

Research
2+ years

PyTorch
CUDA
FPGA
JAX

$250K–$300K / yr

Posted Jun 1, 2026

I

Member of Technical Staff (Infrastructure Engineer, Training and Inference Systems)

Onsite
Inference & ML systems
Member of Technical Staff

Python
PyTorch
JAX
vLLM

Pay not posted

Posted May 28, 2026

Distributed LLM Inference Engineer

AnyscaleSan Francisco +1

Hybrid
Inference & ML systems

PyTorch
CUDA
TensorFlow
vLLM

$170K–$245K / yr

Posted May 27, 2026

Performance Engineer, Inference Systems

AnthropicSan Francisco, CA +2

Inference & ML systems
Visa sponsorship in the job text

Python
SQL
pandas

$350K–$850K / yr

Posted May 20, 2026

C

Inference Engine Development - Member of Technical Staff

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

vLLM

Pay not posted

Posted May 20, 2026

Member of Technical Staff - Inference

Sail ResearchSan Francisco

Onsite
Inference & ML systems
Member of Technical Staff

vLLM

$200K–$300K / yr

Posted May 18, 2026

Applied AI Engineer

InferBengaluru, Karnataka, IN

ML / AI engineering

Python
PyTorch
Hugging Face
pandas
scikit-learn

Pay not posted

Posted May 14, 2026

checked 2 days ago

Engineering Lead

InferBengaluru, Karnataka, IN

Senior
Software engineering
5+ years

Python
Go

Pay not posted

Posted May 14, 2026

checked 2 days ago

RA

Software Engineer, Inference Infrastructure

Rhoda AIMountain View

Inference & ML systems
3+ years

AWS
Kubernetes
GCP
PyTorch
gRPC
+3 more

$175K–$280K / yr

Posted May 12, 2026

Software Engineer, Developer Productivity - Inference Runtime

OpenAISan Francisco +1

Hybrid
Inference & ML systems

Python
C++

$230K–$385K / yr

Posted May 10, 2026

Forward Deployed Engineer

InferSan Francisco, California

Software engineering
2+ years

Python

$110K–$180K / yr

Posted May 9, 2026

checked 2 days ago

Machine Learning Engineer, Inference & Serving (Speech LLM) - San Francisco

PlaudSan Francisco, CA +1

Hybrid
Inference & ML systems

$195K–$365K / yr

Posted May 8, 2026

Forward Deployed Engineer, Strategic Inference

Together AISan Francisco

Inference & ML systems
5+ years

Python
Salesforce
vLLM

$270K–$300K / yr

Posted May 7, 2026

Staff Software Engineer, Inference

CoreWeaveSunnyvale, CA / Bellevue, WA +2

Staff
Inference & ML systems
8+ years

Python
Kubernetes
Go
C++
CUDA
+2 more

$188K–$275K / yr

Posted May 7, 2026

H

Research Engineer, Training & Inference

HarmonicPalo Alto

Onsite
Research
2+ years

Python
C++
PyTorch
CUDA
JAX
+1 more

$200K–$450K / yr

Posted May 7, 2026

EI

AI Inference Infrastructure Software Engineer (Kubernetes / Cloud)

ElastixAI INC.Seattle

Hybrid
Inference & ML systems
3+ years

Python
AWS
Kubernetes
GCP
Go
+7 more

Pay not posted

Posted May 4, 2026

Performance Engineer (Inference, Training & GPU)

World LabsSan Francisco

Onsite
Inference & ML systems
Visa sponsorship in the job text

Python
Go
C++
Rust
PyTorch
+2 more

$200K–$300K / yr

Posted May 1, 2026

Inference

GenesisSan Carlos +2

Onsite
Inference & ML systems
8+ years
2 positions

Python
Go
C++
Rust
CUDA

Pay not posted

Posted Apr 30, 2026

Founding Engineer -- AI Inference Stack

Piris LabsSan Francisco, California

Inference & ML systems

Kubernetes
C++
Rust
CUDA
vLLM

$100K–$200K / yr

Posted Apr 28, 2026

checked 2 days ago

Software Engineer - Voice AI (Inference Runtime)

BasetenSan Francisco +4

Hybrid
Inference & ML systems

Python
Kubernetes
Docker
PyTorch
vLLM

$165K–$330K / yr

Posted Apr 23, 2026

FV

Edge Inference Developer Tooling Founder

Forum VenturesRemote US +6

Remote
Inference & ML systems

Pay not posted

Posted Apr 21, 2026

BC

Machine Learning Engineer - Inference

Blackstar Computers, Inc.San Francisco

Onsite
Inference & ML systems

Pay not posted

Posted Apr 21, 2026

Go to the first page Show the next 40 jobs

JobsWithPay agent

Sign in to use it

Free in beta

Sign in to use the agent

The agent changes this search while you chat. It also compares pay, compares jobs with your résumé and saves jobs for you. All features are free while JobsWithPay is in beta.

Sign in for free