Search tech jobs | JobsWithPay

Jobs Ask AI Pay Interviews Companies CompareSign in

The jobs load…

We read every job from the company's own job board. You apply on the company site.Jobs Job types Internships New graduate jobs Companies Pay Reported pay Check an offer Add your pay Interview questions Add your interview questions Compare with LinkedIn Job sites compared Pay transparency laws API for developers Monthly report Companies we cover Make a portfolio page For companies: find people About Privacy

Filters (1)

Job typeSoftware engineering8ML / AI engineering265Inference & ML systems305Research32Product management21Solutions engineering3Hardware and robotics1

LocationBay Area192New York32Remote (US)28Other places in the US57Remote (all countries)1Outside the US85India4Bengaluru4Chennai1Remote (India)1

LevelIntern11Entry level7Senior61Staff49Principal8Director+6

Work typeOnsite79Hybrid53Remote31

Minimum base payNo minimum$100K+169$150K+168$200K+156$250K+126$300K+91

Date postedAll datesLast 24 hours0Last 7 days13Last 30 days73

Years of experience0 to 2 years3 to 5 years6 to 9 years10 years or more

SkillsPythonAWSSQLTypeScriptKubernetesGCPAzureReactDockerJavaGoC++RustTerraformPyTorchSparkPostgreSQLJavaScriptNode.jsSwiftFigmaExcel

Other filtersOnly AI and ML jobsPosted payVisa sponsorship in the job textMember of Technical StaffOnly manager jobsHide jobs that we found on LinkedIn

305 jobs from 7,835 companies, checked on their job boards 5 h ago

Sort

“Inference”×Inference & ML systems×Remove all filters

Email me new jobs like this

Inference & ML systems jobs. With the words “inference”.

Your email address

Website

One email each day, only when there are new jobs. No account is necessary. You can stop the emails with one click.

Engineering Manager, Deep Learning Inference
NVIDIAUS, CA, Santa Clara +5
- Inference & ML systems
- Manager
- 3+ years
- Python
- C++
- C
- CUDA
$184K–$357K / yr
Posted 16 days ago
checked 5 days ago
Distinguished Engineer, Scaled Out Inferencing
NVIDIAUS, CA, Santa Clara +1
- Principal
- Software engineering
- 7+ years
- Kubernetes
- CUDA
- Linux
- Ray
- vLLM
$320K–$489K / yr
Posted 16 days ago
checked 5 days ago

Senior Software Engineer - AI Inference Performance

NVIDIAUS, CA, Santa Clara

Senior
Inference & ML systems
6+ years

Python
C++
Rust
PyTorch
CUDA
+1 more

$184K–$357K / yr

Posted 16 days ago

checked 5 days ago

Senior Deep Learning Software Engineer, Inference and Model Optimization

NVIDIAUS, CA, Santa Clara +1

Senior
Inference & ML systems
8+ years

Python
PyTorch
Hugging Face

$184K–$357K / yr

Posted 16 days ago

checked 5 days ago

Senior Software Engineer, GPU Code Generation for Machine Learning Inference

NVIDIAUS, CA, Santa Clara +1

Senior
Inference & ML systems
4+ years

Python
C++

$152K–$288K / yr

Posted 16 days ago

checked 5 days ago

Software Engineer II - AI/ML, Neuron Inference, Neuron Inference

Annapurna Labs (U.S.) Inc.Cupertino, California

Inference & ML systems

Python
AWS
PyTorch

$165K–$224K / yr

Posted 16 days ago

checked 2 days ago

Sr. AI Inference Platform Engineer

AppleSeattle, Washington

Senior
Onsite
Inference & ML systems
7+ years

Python
Kubernetes
Go
C++
Grafana
+2 more

Pay not posted

Posted 16 days ago

checked 9 days ago

Forward Deployed Engineer, Inference

CohereUnited States

Onsite
Inference & ML systems
8+ years

Python
AWS
Kubernetes
GCP
Azure
+3 more

$240K–$415K / yr

Posted 17 days ago

Sr. Software Dev Engineer, Alexa LLM Inference, Capacity, & Efficiency

ADCI - KarnatakaBengaluru, Karnataka, IND

Senior
Inference & ML systems
6+ years

Java
C++
C#

Pay not posted

Posted 18 days ago

checked 2 days ago

Senior Machine Learning Engineer, SageMaker Inference

Amazon.com Services LLCBellevue, Washington

Senior
Inference & ML systems

AWS

$168K–$227K / yr

Posted 18 days ago

checked 2 days ago

Senior Software Engineer, ML API – AI Inference

Cerebras SystemsToronto, CAN +1

Senior
Hybrid
Inference & ML systems
5+ years

Python
Kubernetes
Go
C++
Rust
+6 more

Pay not posted

Posted 18 days ago

(Senior/Junior AI Inference Reliability Engineer, Compute Infra

Together AISan Francisco

Entry level
Inference & ML systems

Kubernetes
CUDA
Salesforce

$160K–$280K / yr

Posted 18 days ago

AI Inference Optimization Engineer

QuadricBurlingame, CA (HQ)

Hybrid
Inference & ML systems
3+ years

Python
C++
C
CUDA

$160K–$195K / yr

Posted 18 days ago

AI Inference Framework Engineer

QuadricBurlingame, CA (HQ)

Hybrid
Inference & ML systems
3+ years

Python
C++
PyTorch
C
CUDA
+1 more

$160K–$195K / yr

Posted 18 days ago

LS

Associate Director/Director, Inference Engineering

Lila SciencesCambridge, MA USA +3

Director+
Inference & ML systems
Manager

vLLM

$204K–$348K / yr

Posted 19 days ago

M

#3 - Data Scientist Senior - Causal Inference - Databricks

MuttdataCiudad de Mexico +1

Senior
Remote
Inference & ML systems
3+ years
2 positions

Python
AWS
SQL
GCP
Azure
+6 more

Pay not posted

Posted 19 days ago

Senior Inference Engineer

UniphoreUSA - CA - Palo Alto

Senior
Inference & ML systems
3+ years

Python
C++
PyTorch
CUDA
Grafana
+2 more

$159K–$199K / yr

Posted 20 days ago

checked 2 days ago

GenAI Algorithms Intern – Model Optimization for Inference

NVIDIASwitzerland, Zurich

Intern
Inference & ML systems

Python
PyTorch

Pay not posted

Posted 20 days ago

checked 5 days ago

Machine learning engineer II, AWS Inference Optimization

Amazon Development Center U.S., Inc.Santa Clara, California

Inference & ML systems
3+ years

AWS
Java
C++
C#
CUDA
+1 more

$165K–$224K / yr

Posted 22 days ago

checked 2 days ago

Engineering Manager, Private Cloud Compute Inference Routing

AppleSeattle, Washington

Onsite
Inference & ML systems
Manager

Kubernetes
Java
Go
C++
Swift
+2 more

Pay not posted

Posted 22 days ago

checked 9 days ago

Senior Machine Learning Engineer, Inference - USA

InworldMountain View, California

Senior
Inference & ML systems

Python
Kubernetes
C++
Rust
CUDA
+2 more

$250K–$300K / yr

Posted 23 days ago

Machine Learning Engineer, SageMaker AI Inference

Amazon Development Center U.S., Inc.Bellevue, Washington

Inference & ML systems

$144K–$194K / yr

Posted 23 days ago

checked 2 days ago

Senior Backend Engineer, Inference Cloud

Cerebras SystemsSunnyvale, CA +1

Senior
Hybrid
Inference & ML systems
8+ years

PostgreSQL
GraphQL
Redis

Pay not posted

Posted 23 days ago

Member of Technical Staff (Model Quantization & Inference)

Lamb LabsLondon, England, GB

Inference & ML systems
Member of Technical Staff

Python
PyTorch
FPGA

Pay not posted

Posted 24 days ago

checked 2 days ago

Staff Software Engineer, GPU Inference

Cerebras SystemsToronto, CAN +1

Staff
Hybrid
Inference & ML systems
8+ years

Python
Kubernetes
C++
PyTorch
CUDA
+2 more

Pay not posted

Posted 24 days ago

Staff Machine Learning Engineer, LLM Inference Optimization

NebiusAmsterdam, Netherlands +6

Staff
Remote
Inference & ML systems

Python
PyTorch
CUDA
Ray
vLLM

Pay not posted

Posted 25 days ago

[AI Frontier Div.] AI Inference Platform & Operations Engineer (5년 이상)

KRAFTONSeoul +1

Inference & ML systems

Pay not posted

Posted 25 days ago

RA

Software Engineer Intern, Inference

Rhoda AIMountain View

Intern
Inference & ML systems

Python
C++
PyTorch
CUDA

Pay not posted

Posted 25 days ago

(Staff / Senior Staff) AI Inference Reliability Engineer, Compute Infra

Together AISan Francisco

Staff
Inference & ML systems

Kubernetes
CUDA
Salesforce

$250K–$320K / yr

Posted 25 days ago

Senior Software Engineer, Private Cloud Compute Inference Routing

AppleCupertino, California +1

Senior
Onsite
Inference & ML systems
3+ years

Kubernetes
Java
Go
C++
Swift
+3 more

Pay not posted

Posted 26 days ago

checked 9 days ago

AI Inference Core - Senior SDET, Release Integration Testing

Cerebras SystemsSunnyvale, CA +1

Senior
Hybrid
Inference & ML systems

Python
Kubernetes
Go

Pay not posted

Posted 26 days ago

DU

Staff Applied Scientist, Experimentation and Causal Inference

DoorDash USACalifornia, CA +3

Staff
Research
6+ years

SQL

$194K–$285K / yr

Posted 29 days ago

Research Engineer - Inference

Prime IntellectSan Francisco +1

Research
Visa sponsorship in the job text

Python
PyTorch
CUDA
vLLM

$150K–$350K / yr

Posted 29 days ago

Staff Inference Engineer

UniphoreUSA - CA - Palo Alto

Staff
Inference & ML systems
5+ years

Python
C++
PyTorch
CUDA
Grafana
+2 more

$175K–$219K / yr

Posted Oct 16, 2026

checked 2 days ago

Z

Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud

ZyphraSan Francisco

Onsite
Inference & ML systems
Visa sponsorship in the job text

Python
AWS
Kubernetes
GCP
Azure
+9 more

Pay not posted

Posted Oct 15, 2026

DM

Senior Staff Inference Performance Engineer

d-MatrixSanta Clara +1

Staff
Hybrid
Inference & ML systems
8+ years

Python
Kubernetes
C++
Rust
C
+3 more

$175K–$265K / yr

Posted Oct 15, 2026

DM

Staff Test & Release Engineer, Inference Cloud

d-MatrixSanta Clara

Staff
Hybrid
Inference & ML systems
6+ years

Python
Kubernetes
Azure
Rust
Helm
+1 more

$155K–$235K / yr

Posted Oct 15, 2026

Senior/Staff Software Engineer (Back-End), Inference

CohereCanada +6

Staff
Remote
Inference & ML systems

Python
Java
Go
C++
Rust

$205K–$315K / yr

Posted Oct 15, 2026

G

Member of Technical Staff - Inference

GhostSan Francisco

Onsite
Inference & ML systems
Member of Technical Staff

Python
C++
CUDA

Pay not posted

Posted Oct 15, 2026

T

Working Student - LLM Quantization & Inference Performance

TensordyneMunich, Germany +1

Intern
Inference & ML systems

Python
PyTorch

Pay not posted

Posted Oct 14, 2026

Go to the first page Show the next 40 jobs

JobsWithPay agent

Sign in to use it

Free in beta

Sign in to use the agent

The agent changes this search while you chat. It also compares pay, compares jobs with your résumé and saves jobs for you. All features are free while JobsWithPay is in beta.

Sign in for free