Search tech jobs | JobsWithPay

Jobs Ask AI Pay Interviews Companies CompareSign in

The jobs load…

We read every job from the company's own job board. You apply on the company site.Jobs Job types Internships New graduate jobs Companies Pay Reported pay Check an offer Add your pay Interview questions Add your interview questions Compare with LinkedIn Job sites compared Pay transparency laws API for developers Monthly report Companies we cover Make a portfolio page For companies: find people About Privacy

JobsWithPay agent

Sign in to use it

Free in beta

Sign in to use the agent

The agent changes this search while you chat. It also compares pay, compares jobs with your résumé and saves jobs for you. All features are free while JobsWithPay is in beta.

Sign in for free

Filters (1)

Job typeSoftware engineering8ML / AI engineering265Inference & ML systems305Research32Product management21Solutions engineering3Hardware and robotics1

LocationBay Area168New York27Remote (US)23Other places in the US43Remote (all countries)1Outside the US76India7Bengaluru6Mumbai1Chennai1Remote (India)1

LevelIntern10Entry level7Senior51Staff45Principal6Director+3

Work typeOnsite67Hybrid44Remote27

Minimum base payNo minimum$100K+146$150K+146$200K+138$250K+113$300K+82

Date postedAll datesLast 24 hours0Last 7 days10Last 30 days61

Years of experience0 to 2 years3 to 5 years6 to 9 years10 years or more

SkillsPythonAWSSQLTypeScriptKubernetesGCPAzureReactDockerJavaGoC++RustTerraformPyTorchSparkPostgreSQLJavaScriptNode.jsSwiftFigmaExcel

Other filtersOnly AI and ML jobsPosted payVisa sponsorship in the job textMember of Technical StaffOnly manager jobsHide jobs that we found on LinkedIn

265 jobs from 7,835 companies, checked on their job boards 5 h ago

Sort

“Inference”×ML / AI engineering×Remove all filters

Email me new jobs like this

ML / AI engineering jobs. With the words “inference”.

Your email address

Website

One email each day, only when there are new jobs. No account is necessary. You can stop the emails with one click.

Forward Deployed Engineer, Inference
CohereUnited States
- Onsite
- Inference & ML systems
- 8+ years
- Python
- AWS
- Kubernetes
- GCP
- Azure
- +3 more
$240K–$415K / yr
Posted 17 days ago
Sr. Software Dev Engineer, Alexa LLM Inference, Capacity, & Efficiency
ADCI - KarnatakaBengaluru, Karnataka, IND
- Senior
- Inference & ML systems
- 6+ years
- Java
- C++
- C#
Pay not posted
Posted 18 days ago
checked 2 days ago
Senior Machine Learning Engineer, SageMaker Inference

Amazon.com Services LLCBellevue, Washington

Senior
Inference & ML systems

AWS

$168K–$227K / yr

Posted 18 days ago

checked 2 days ago

Senior Software Engineer, ML API – AI Inference

Cerebras SystemsToronto, CAN +1

Senior
Hybrid
Inference & ML systems
5+ years

Python
Kubernetes
Go
C++
Rust
+6 more

Pay not posted

Posted 18 days ago

(Senior/Junior AI Inference Reliability Engineer, Compute Infra

Together AISan Francisco

Entry level
Inference & ML systems

Kubernetes
CUDA
Salesforce

$160K–$280K / yr

Posted 18 days ago

AI Inference Optimization Engineer

QuadricBurlingame, CA (HQ)

Hybrid
Inference & ML systems
3+ years

Python
C++
C
CUDA

$160K–$195K / yr

Posted 18 days ago

AI Inference Framework Engineer

QuadricBurlingame, CA (HQ)

Hybrid
Inference & ML systems
3+ years

Python
C++
PyTorch
C
CUDA
+1 more

$160K–$195K / yr

Posted 18 days ago

M

#3 - Data Scientist Senior - Causal Inference - Databricks

MuttdataCiudad de Mexico +1

Senior
Remote
Inference & ML systems
3+ years
2 positions

Python
AWS
SQL
GCP
Azure
+6 more

Pay not posted

Posted 19 days ago

Senior Inference Engineer

UniphoreUSA - CA - Palo Alto

Senior
Inference & ML systems
3+ years

Python
C++
PyTorch
CUDA
Grafana
+2 more

$159K–$199K / yr

Posted 20 days ago

checked 2 days ago

GenAI Algorithms Intern – Model Optimization for Inference

NVIDIASwitzerland, Zurich

Intern
Inference & ML systems

Python
PyTorch

Pay not posted

Posted 20 days ago

checked 5 days ago

Machine learning engineer II, AWS Inference Optimization

Amazon Development Center U.S., Inc.Santa Clara, California

Inference & ML systems
3+ years

AWS
Java
C++
C#
CUDA
+1 more

$165K–$224K / yr

Posted 22 days ago

checked 2 days ago

Senior Machine Learning Engineer, Inference - USA

InworldMountain View, California

Senior
Inference & ML systems

Python
Kubernetes
C++
Rust
CUDA
+2 more

$250K–$300K / yr

Posted 23 days ago

Machine Learning Engineer, SageMaker AI Inference

Amazon Development Center U.S., Inc.Bellevue, Washington

Inference & ML systems

$144K–$194K / yr

Posted 23 days ago

checked 2 days ago

Member of Technical Staff (Model Quantization & Inference)

Lamb LabsLondon, England, GB

Inference & ML systems
Member of Technical Staff

Python
PyTorch
FPGA

Pay not posted

Posted 24 days ago

checked 2 days ago

Staff Software Engineer, GPU Inference

Cerebras SystemsToronto, CAN +1

Staff
Hybrid
Inference & ML systems
8+ years

Python
Kubernetes
C++
PyTorch
CUDA
+2 more

Pay not posted

Posted 24 days ago

Staff Machine Learning Engineer, LLM Inference Optimization

NebiusAmsterdam, Netherlands +6

Staff
Remote
Inference & ML systems

Python
PyTorch
CUDA
Ray
vLLM

Pay not posted

Posted 25 days ago

RA

Software Engineer Intern, Inference

Rhoda AIMountain View

Intern
Inference & ML systems

Python
C++
PyTorch
CUDA

Pay not posted

Posted 25 days ago

(Staff / Senior Staff) AI Inference Reliability Engineer, Compute Infra

Together AISan Francisco

Staff
Inference & ML systems

Kubernetes
CUDA
Salesforce

$250K–$320K / yr

Posted 25 days ago

AI Inference Core - Senior SDET, Release Integration Testing

Cerebras SystemsSunnyvale, CA +1

Senior
Hybrid
Inference & ML systems

Python
Kubernetes
Go

Pay not posted

Posted 26 days ago

DU

Staff Applied Scientist, Experimentation and Causal Inference

DoorDash USACalifornia, CA +3

Staff
Research
6+ years

SQL

$194K–$285K / yr

Posted 29 days ago

Research Engineer - Inference

Prime IntellectSan Francisco +1

Research
Visa sponsorship in the job text

Python
PyTorch
CUDA
vLLM

$150K–$350K / yr

Posted 29 days ago

Staff Inference Engineer

UniphoreUSA - CA - Palo Alto

Staff
Inference & ML systems
5+ years

Python
C++
PyTorch
CUDA
Grafana
+2 more

$175K–$219K / yr

Posted Oct 16, 2026

checked 2 days ago

Z

Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud

ZyphraSan Francisco

Onsite
Inference & ML systems
Visa sponsorship in the job text

Python
AWS
Kubernetes
GCP
Azure
+9 more

Pay not posted

Posted Oct 15, 2026

DM

Staff Test & Release Engineer, Inference Cloud

d-MatrixSanta Clara

Staff
Hybrid
Inference & ML systems
6+ years

Python
Kubernetes
Azure
Rust
Helm
+1 more

$155K–$235K / yr

Posted Oct 15, 2026

G

Member of Technical Staff - Inference

GhostSan Francisco

Onsite
Inference & ML systems
Member of Technical Staff

Python
C++
CUDA

Pay not posted

Posted Oct 15, 2026

T

Working Student - LLM Quantization & Inference Performance

TensordyneMunich, Germany +1

Intern
Inference & ML systems

Python
PyTorch

Pay not posted

Posted Oct 14, 2026

Research Scientist - Decentralized Training and Inference Verification

Pluralis ResearchSan Francisco +1

Remote
Research
Visa sponsorship in the job text

Pay not posted

Posted Oct 14, 2026

Research Scientist - Geo-Distributed Inference

Pluralis ResearchSan Francisco +1

Remote
Research
Visa sponsorship in the job text

Pay not posted

Posted Oct 14, 2026

I

Engineering Manager

InferactSan Francisco

Onsite
Software engineering
Manager
2+ years
Visa sponsorship in the job text

Kubernetes
PyTorch
CUDA
vLLM

$200K–$400K / yr

Posted Oct 14, 2026

Principal Engineer: Annapurna Labs Training and Inference , Annapurna Labs, AWS Neuron SDK

Annapurna Labs (U.S.) Inc.Seattle, Washington +1

Principal
Inference & ML systems

AWS
JAX

$200K–$311K / yr

Posted Oct 14, 2026

checked 2 days ago

Engineering Manager, Inference Router

Cerebras SystemsSunnyvale, CA +1

Hybrid
Inference & ML systems
Manager
8+ years

Kubernetes
C++
vLLM

Pay not posted

Posted Oct 13, 2026

Software Engineer II - AI/ML, Neuron Inference, Inference

Annapurna Labs (U.S.) Inc.Cupertino, California

Inference & ML systems

Python
AWS
PyTorch

$165K–$224K / yr

Posted Oct 13, 2026

checked 2 days ago

ML Systems Research Engineer, RL / Inference / Agent Systems

Advanced Micro Devices, IncSanta Clara, California

Onsite
Research

Python
Kubernetes
PyTorch
CUDA
JAX
+2 more

Pay not posted

Posted Oct 12, 2026

checked 2 days ago

Senior Applied Scientist, Efficient LLM Inference & Model Optimization

NebiusLondon, United Kingdom +7

Senior
Remote
Research
4 positions

Python
PyTorch
CUDA
vLLM

Pay not posted

Posted Oct 12, 2026

AI Engineer 5 (FM Hosting, LLM Inference)

Capital OneNew York, NY +4

Inference & ML systems
6+ years
2 positions
Visa sponsorship in the job text

Python
AWS
GCP
Azure
Java
+7 more

$230K–$286K / yr

Posted Oct 9, 2026

checked 2 days ago

Machine Learning Engineer - Inference Maintainer & Developer Experience

RoboflowSan Francisco, California +2

Remote
Inference & ML systems
5+ years
2 positions

PyTorch
TensorFlow
vLLM

$155K–$180K / yr

Posted Oct 8, 2026

checked 2 days ago

Principal Engineer, Inference Memory and Storage Systems

DigitalOceanSeattle +1

Principal
Inference & ML systems
15+ years

vLLM

$250K–$312K / yr

Posted Oct 8, 2026

H

Inference Optimization Engineer

HedraSan Francisco

Inference & ML systems

Python
C++
PyTorch
CUDA
vLLM

Pay not posted

Posted Oct 8, 2026

PG

Staff Software Engineer, Console GPU Inference

PlayStation GlobalUnited Kingdom, London +1

Staff
Inference & ML systems
10+ years

C++
C

Pay not posted

Posted Oct 8, 2026

L

Forward Deployed Engineer – AI Inference (Intern)

LyceumBerlin

Intern
Onsite
Inference & ML systems

vLLM

Pay not posted

Posted Oct 8, 2026

Go to the first page Show the next 40 jobs