Search tech jobs | JobsWithPay

Jobs Ask AI Pay Interviews Companies CompareSign in

The jobs load…

We read every job from the company's own job board. You apply on the company site.Jobs Job types Internships New graduate jobs Companies Pay Reported pay Check an offer Add your pay Interview questions Add your interview questions Compare with LinkedIn Job sites compared Pay transparency laws API for developers Monthly report Companies we cover Make a portfolio page For companies: find people About Privacy

JobsWithPay agent

Sign in to use it

Free in beta

Sign in to use the agent

The agent changes this search while you chat. It also compares pay, compares jobs with your résumé and saves jobs for you. All features are free while JobsWithPay is in beta.

Sign in for free

Filters (1)

Job typeSoftware engineering8ML / AI engineering265Inference & ML systems305Research32Product management21Solutions engineering3Hardware and robotics1

LocationBay Area168New York27Remote (US)23Other places in the US43Remote (all countries)1Outside the US76India7Bengaluru6Mumbai1Chennai1Remote (India)1

LevelIntern10Entry level7Senior51Staff45Principal6Director+3

Work typeOnsite67Hybrid44Remote27

Minimum base payNo minimum$100K+146$150K+146$200K+138$250K+113$300K+82

Date postedAll datesLast 24 hours0Last 7 days10Last 30 days60

Years of experience0 to 2 years3 to 5 years6 to 9 years10 years or more

SkillsPythonAWSSQLTypeScriptKubernetesGCPAzureReactDockerJavaGoC++RustTerraformPyTorchSparkPostgreSQLJavaScriptNode.jsSwiftFigmaExcel

Other filtersOnly AI and ML jobsPosted payVisa sponsorship in the job textMember of Technical StaffOnly manager jobsHide jobs that we found on LinkedIn

265 jobs from 7,835 companies, checked on their job boards 6 h ago

Sort

“Inference”×ML / AI engineering×Remove all filters

Email me new jobs like this

ML / AI engineering jobs. With the words “inference”.

Your email address

Website

One email each day, only when there are new jobs. No account is necessary. You can stop the emails with one click.

AI Research Engineer, Inference
Hudson River TradingLondon, United Kingdom +2
- Research
- 2+ years
- PyTorch
- CUDA
- FPGA
- JAX
$250K–$300K / yr
Posted Jun 1, 2026
I
Member of Technical Staff (Infrastructure Engineer, Training and Inference Systems)
InherentLondon
- Onsite
- Inference & ML systems
- Member of Technical Staff
- Python
- PyTorch
- JAX
- vLLM
Pay not posted
Posted May 28, 2026
Distributed LLM Inference Engineer
AnyscaleSan Francisco

+1

Hybrid
Inference & ML systems

PyTorch
CUDA
TensorFlow
vLLM

$170K–$245K / yr

Posted May 27, 2026

Performance Engineer, Inference Systems

AnthropicSan Francisco, CA +2

Inference & ML systems
Visa sponsorship in the job text

Python
SQL
pandas

$350K–$850K / yr

Posted May 20, 2026

Applied AI Engineer

InferBengaluru, Karnataka, IN

ML / AI engineering

Python
PyTorch
Hugging Face
pandas
scikit-learn

Pay not posted

Posted May 14, 2026

checked 2 days ago

RA

Software Engineer, Inference Infrastructure

Rhoda AIMountain View

Inference & ML systems
3+ years

AWS
Kubernetes
GCP
PyTorch
gRPC
+3 more

$175K–$280K / yr

Posted May 12, 2026

Machine Learning Engineer, Inference & Serving (Speech LLM) - San Francisco

PlaudSan Francisco, CA +1

Hybrid
Inference & ML systems

$195K–$365K / yr

Posted May 8, 2026

Forward Deployed Engineer, Strategic Inference

Together AISan Francisco

Inference & ML systems
5+ years

Python
Salesforce
vLLM

$270K–$300K / yr

Posted May 7, 2026

Staff Software Engineer, Inference

CoreWeaveSunnyvale, CA / Bellevue, WA +2

Staff
Inference & ML systems
8+ years

Python
Kubernetes
Go
C++
CUDA
+2 more

$188K–$275K / yr

Posted May 7, 2026

H

Research Engineer, Training & Inference

HarmonicPalo Alto

Onsite
Research
2+ years

Python
C++
PyTorch
CUDA
JAX
+1 more

$200K–$450K / yr

Posted May 7, 2026

EI

AI Inference Infrastructure Software Engineer (Kubernetes / Cloud)

ElastixAI INC.Seattle

Hybrid
Inference & ML systems
3+ years

Python
AWS
Kubernetes
GCP
Go
+7 more

Pay not posted

Posted May 4, 2026

Performance Engineer (Inference, Training & GPU)

World LabsSan Francisco

Onsite
Inference & ML systems
Visa sponsorship in the job text

Python
Go
C++
Rust
PyTorch
+2 more

$200K–$300K / yr

Posted May 1, 2026

Inference

GenesisSan Carlos +2

Onsite
Inference & ML systems
8+ years
2 positions

Python
Go
C++
Rust
CUDA

Pay not posted

Posted Apr 30, 2026

Founding Engineer -- AI Inference Stack

Piris LabsSan Francisco, California

Inference & ML systems

Kubernetes
C++
Rust
CUDA
vLLM

$100K–$200K / yr

Posted Apr 28, 2026

checked 2 days ago

Software Engineer - Voice AI (Inference Runtime)

BasetenSan Francisco +4

Hybrid
Inference & ML systems

Python
Kubernetes
Docker
PyTorch
vLLM

$165K–$330K / yr

Posted Apr 23, 2026

BC

Machine Learning Engineer - Inference

Blackstar Computers, Inc.San Francisco

Onsite
Inference & ML systems

Pay not posted

Posted Apr 21, 2026

Research Engineer, Model Inference & Serving - Paris

H CompanyHybrid Paris

Hybrid
Research

Python
Kubernetes
Go
C++
Rust
+4 more

Pay not posted

Posted Apr 14, 2026

Member of Technical Staff (AI Inference Engineer)

PerplexitySan Francisco +2

Inference & ML systems
Member of Technical Staff
3+ years

Python
Rust
PyTorch
CUDA
JAX
+1 more

$220K–$485K / yr

Posted Apr 13, 2026

Member of Technical Staff (AI Inference Engineer)

PerplexityLondon

Inference & ML systems
Member of Technical Staff
3+ years

Python
Kubernetes
Rust
PyTorch
CUDA
+2 more

Pay not posted

Posted Apr 13, 2026

Research Engineer, Model Inference & Serving - London

H CompanyHybrid London

Hybrid
Research

Python
Kubernetes
Go
C++
Rust
+4 more

Pay not posted

Posted Apr 10, 2026

Staff / Senior Staff Machine Learning Engineer, Inference - Switzerland

InworldSwitzerland

Staff
Remote
Inference & ML systems

Python
Kubernetes
C++
Rust
CUDA
+2 more

Pay not posted

Posted Apr 7, 2026

Staff / Senior Staff Machine Learning Engineer, Inference - UK

InworldUK

Staff
Remote
Inference & ML systems

Python
Kubernetes
C++
Rust
CUDA
+2 more

£140K–£200K / yr

Posted Apr 7, 2026

Senior / Lead Machine Learning Engineer, Inference

InworldGermany +1

Senior
Remote
Inference & ML systems
2 positions

Python
Kubernetes
C++
Rust
CUDA
+2 more

Pay not posted

Posted Apr 7, 2026

Staff / Senior Staff Machine Learning Engineer, Inference - USA

InworldMountain View, California

Staff
Hybrid
Inference & ML systems

Python
Kubernetes
C++
Rust
CUDA
+2 more

$270K–$430K / yr

Posted Apr 7, 2026

IL

Staff Software Engineer (Inference Platform), London

Isomorphic LabsLondon

Staff
Inference & ML systems

Pay not posted

Posted Mar 26, 2026

A

Member of Technical Staff - Inference

ai&Yokohama +1

Hybrid
Inference & ML systems
Member of Technical Staff

Pay not posted

Posted Mar 20, 2026

Staff / Principal Software Engineer, Inference Platform - USA

InworldMountain View, California

Principal
Hybrid
Inference & ML systems
8+ years

Kubernetes
Java
Go
C++
Rust
+2 more

$280K–$350K / yr

Posted Mar 17, 2026

Senior Deployment Engineer - LLM Inference & Optimization

CoreWeaveBellevue, WA/ San Francisco, CA/ Sunnyvale, CA +2

Senior
Inference & ML systems
5+ years

Python
PyTorch
CUDA
Hugging Face
vLLM

Pay not posted

Posted Mar 16, 2026

Senior AI Engineer — Inference & Agent Systems

Arcana AnalyticsUnited States +1

Senior
Inference & ML systems
2 positions

Pay not posted

Posted Mar 15, 2026

F

Software Engineer – AI Inference Engine

FriendliAISan Francisco +1

Hybrid
Inference & ML systems
5+ years
2 positions

Python
C++

Pay not posted

Posted Mar 15, 2026

Member of Technical Staff - ML Systems & Inference

Gimlet LabsSan Francisco, CA

Onsite
Inference & ML systems
Member of Technical Staff

Python
C++
vLLM

$150K–$390K / yr

Posted Mar 10, 2026

TL

Software Engineer, AI Inference / HPC

Topaz LabsDallas, TX

Onsite
Inference & ML systems
1+ years

C++
C

$110K–$150K / yr

Posted Mar 5, 2026

M

Member of Technical Staff, Inference & RL Systems

MagicSan Francisco

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

$275K–$550K / yr

Posted Feb 28, 2026

Head of Inference Performance Visibility

Director+
Onsite
Inference & ML systems
Manager

C++
Rust

$150K–$400K / yr

Posted Feb 19, 2026

AI Inference Core - Software Integration Engineer

Cerebras SystemsSunnyvale, CA +1

Hybrid
Inference & ML systems

Python
Go
C++

Pay not posted

Posted Feb 5, 2026

Senior Software Engineer I, Inference

CoreWeaveSunnyvale, CA / Bellevue, WA +2

Senior
Inference & ML systems
4+ years

Python
PyTorch
vLLM

$139K–$204K / yr

Posted Jan 23, 2026

AI Researcher — Inference Optimization

Featherless AIRemote (world)

Research

Python
PyTorch
CUDA
vLLM

Pay not posted

Posted Jan 23, 2026

I

Member of Technical Staff, Exceptional Generalist (Remote)

Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

vLLM

Pay not posted

Posted Jan 22, 2026

Machine Learning Engineer — Inference Optimization

Featherless AIRemote (world)

Inference & ML systems

PyTorch
CUDA
vLLM

Pay not posted

Posted Jan 22, 2026

I

Member of Technical Staff, Cloud Orchestration

InferactSan Francisco

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Python
AWS
Kubernetes
GCP
Azure
+5 more

$200K–$400K / yr

Posted Jan 22, 2026

Go to the first page Show the next 40 jobs