Search tech jobs | JobsWithPay

Jobs Ask AI Pay Interviews Companies CompareSign in

The jobs load…

We read every job from the company's own job board. You apply on the company site.Jobs Job types Internships New graduate jobs Companies Pay Reported pay Check an offer Add your pay Interview questions Add your interview questions Compare with LinkedIn Job sites compared Pay transparency laws API for developers Monthly report Companies we cover Make a portfolio page For companies: find people About Privacy

Filters (1)

Job typeSoftware engineering8ML / AI engineering265Inference & ML systems305Research32Product management21Solutions engineering3Hardware and robotics1

LocationBay Area192New York32Remote (US)28Other places in the US57Remote (all countries)1Outside the US85India4Bengaluru4Chennai1Remote (India)1

LevelIntern11Entry level7Senior61Staff49Principal8Director+6

Work typeOnsite79Hybrid53Remote31

Minimum base payNo minimum$100K+169$150K+168$200K+156$250K+126$300K+91

Date postedAll datesLast 24 hours0Last 7 days13Last 30 days73

Years of experience0 to 2 years3 to 5 years6 to 9 years10 years or more

SkillsPythonAWSSQLTypeScriptKubernetesGCPAzureReactDockerJavaGoC++RustTerraformPyTorchSparkPostgreSQLJavaScriptNode.jsSwiftFigmaExcel

Other filtersOnly AI and ML jobsPosted payVisa sponsorship in the job textMember of Technical StaffOnly manager jobsHide jobs that we found on LinkedIn

305 jobs from 7,835 companies, checked on their job boards 5 h ago

Sort

“Inference”×Inference & ML systems×Remove all filters

Email me new jobs like this

Inference & ML systems jobs. With the words “inference”.

Your email address

Website

One email each day, only when there are new jobs. No account is necessary. You can stop the emails with one click.

L
Member of Technical Staff – AI Inference platform
LyceumZürich
- Onsite
- Inference & ML systems
- Member of Technical Staff
- 3+ years
- Python
- Kubernetes
- Go
- Grafana
- Prometheus
- +1 more
Pay not posted
Posted Jul 22, 2026
Sr. Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs, Annapurna Labs
Amazon.com Services LLCSeattle, Washington +1
- Senior
- Inference & ML systems
- 5+ years
- AWS
- C++
- C
- Linux
$168K–$262K / yr
Posted Jul 21, 2026
checked 2 days ago

CL

Member of Technical Staff — Inference Infrastructure

Causal LabsSan Francisco +1

Onsite
Inference & ML systems
Member of Technical Staff

Kubernetes
PyTorch
JAX
Ray
vLLM

Pay not posted

Posted Jul 19, 2026

[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering

Together AISan Francisco

Entry level
Inference & ML systems

Python
Kubernetes
Go
Rust
Ansible
+3 more

$160K–$280K / yr

Posted Jul 16, 2026

P

Member of Engineering (Inference Infrastructure)

PoolsideRemote (EMEA)

Remote
Inference & ML systems

Kubernetes
Go

Pay not posted

Posted Jul 15, 2026

Senior Staff / Principal Machine Learning Scientist, AI Inference & Optimization

NetskopeSanta Clara, California +1

Principal
Inference & ML systems
10+ years

Python
C++
vLLM

$125K–$272K / yr

Posted Jul 14, 2026

Senior SDET, Inference Platform

Cerebras SystemsSunnyvale, CA +1

Senior
Hybrid
Inference & ML systems
3+ years

Python
Kubernetes

Pay not posted

Posted Jul 13, 2026

Sr. Model Engineer, RL Inference

xAIPalo Alto, CA

Senior
Inference & ML systems

Python
C++
Rust
PyTorch
JAX
+1 more

$160K–$250K / yr

Posted Jul 6, 2026

NA

LLM Inference Engineer

Near AISan Francisco or Remote +1

Remote
Inference & ML systems

PyTorch
CUDA
vLLM

Pay not posted

Posted Jul 6, 2026

Member of Technical Staff - Research, Inference

ModalNew York +1

Research
Member of Technical Staff

$150K–$350K / yr

Posted Jul 5, 2026

Senior Inference ML API SDET

Cerebras SystemsSunnyvale, CA +1

Senior
Onsite
Inference & ML systems
5+ years

Python
Go
C++

Pay not posted

Posted Jun 29, 2026

F

Staff AI Inference and Acceleration Engineer

FigureSan Jose, CA +1

Staff
Inference & ML systems
8+ years

Python
C++
CUDA
JAX

$180K–$275K / yr

Posted Jun 26, 2026

I

Member of Technical Staff, AMD GPU Kernel Engineering

InferactSan Francisco

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

PyTorch
CUDA
vLLM

$200K–$400K / yr

Posted Jun 26, 2026

I

Member of Technical Staff, TPU Kernel Engineering

InferactSingapore

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

PyTorch
CUDA
JAX
vLLM

SGD 200K–SGD 400K / yr

Posted Jun 26, 2026

I

Member of Technical Staff, AMD GPU Kernel Engineering

InferactSingapore

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

PyTorch
CUDA
vLLM

SGD 200K–SGD 400K / yr

Posted Jun 25, 2026

M

Member of Technical Staff, Inference

MirendilSan Francisco

Onsite
Inference & ML systems
Member of Technical Staff

$300K–$400K / yr

Posted Jun 24, 2026

I

Member of Technical Staff, Performance and Scale

InferactSingapore

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Go
C++
Rust

SGD 200K–SGD 400K / yr

Posted Jun 24, 2026

I

Member of Technical Staff, Inference

InferactSingapore

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Python
PyTorch
vLLM

SGD 200K–SGD 400K / yr

Posted Jun 24, 2026

I

Member of Technical Staff, Cloud Orchestration

InferactSingapore

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Python
AWS
Kubernetes
GCP
Azure
+5 more

SGD 200K–SGD 400K / yr

Posted Jun 24, 2026

ML Engineer, Inference & Optimization

PikaUS remote

Remote
Inference & ML systems
5+ years

CUDA

Pay not posted

Posted Jun 23, 2026

Software Engineer, Inference Platform

Cerebras SystemsSunnyvale, CA +1

Onsite
Inference & ML systems
3+ years

Kubernetes
Go
C++

Pay not posted

Posted Jun 20, 2026

Staff Software Engineer, Inference Platform

Cerebras SystemsSunnyvale, CA +1

Staff
Onsite
Inference & ML systems
8+ years

Kubernetes
Go
C++

Pay not posted

Posted Jun 19, 2026

I

Member of Technical Staff, Inference

InferactSan Francisco

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Python
PyTorch
vLLM

$200K–$400K / yr

Posted Jun 18, 2026

I

Member of Technical Staff, TPU Kernel Engineering

InferactSan Francisco

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

PyTorch
CUDA
JAX
vLLM

$200K–$400K / yr

Posted Jun 17, 2026

Sr. Software Engineer, Inference

CoreWeave EuropeWarsaw, Poland +1

Senior
Inference & ML systems
3+ years

Python
Kubernetes
Go
C++
CUDA
+4 more

Pay not posted

Posted Jun 15, 2026

Member of Technical Staff, Inference

Radical NumericsSan Francisco

Inference & ML systems
Member of Technical Staff

Python
PyTorch
CUDA
vLLM

Pay not posted

Posted Jun 15, 2026

Staff+ Software Engineer, Inference Velocity

AnthropicRemote-Friendly (Travel-Required) +3

Staff
Remote
Inference & ML systems
8+ years
Visa sponsorship in the job text

AWS
CUDA

$405K–$485K / yr

Posted Jun 12, 2026

NL

Member of Technical Staff — Model Optimization and Inference (New Grad)

Nuance LabsSeattle, Washington +1

Entry level
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Python
PyTorch
CUDA
vLLM

$200K–$300K / yr

Posted Jun 11, 2026

Staff + Senior Software Engineer, Inference Infrastructure

AnthropicSan Francisco, CA +2

Staff
Inference & ML systems
Visa sponsorship in the job text

Python
AWS
Kubernetes
GCP
Azure
+1 more

$320K–$485K / yr

Posted Jun 8, 2026

NL

Member of Technical Staff — Model Optimization and Inference (Experienced)

Nuance LabsSeattle, Washington +1

Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Python
PyTorch
CUDA
vLLM

$250K–$350K / yr

Posted Jun 5, 2026

ML Engineer - Inference & Model Deployment

HiringCafeCupertino

Onsite
Inference & ML systems

vLLM

$250K–$310K / yr

Posted Jun 5, 2026

Inference Systems Engineer: Linux Kernel Test and Validation

CedanaRemote (US)

Remote
Inference & ML systems
5+ years

Kubernetes
Linux
vLLM

$180K / yr

Posted Jun 3, 2026

checked 2 days ago

Senior Director of Engineering - Inference Serving

SambaNovaSan Jose, California +1

Director+
Inference & ML systems
Manager
12+ years

Python
Kubernetes
Go
Rust

$245K–$325K / yr

Posted Jun 3, 2026

AI Research Engineer, Inference

Hudson River TradingLondon, United Kingdom +2

Research
2+ years

PyTorch
CUDA
FPGA
JAX

$250K–$300K / yr

Posted Jun 1, 2026

I

Member of Technical Staff (Infrastructure Engineer, Training and Inference Systems)

Onsite
Inference & ML systems
Member of Technical Staff

Python
PyTorch
JAX
vLLM

Pay not posted

Posted May 28, 2026

Distributed LLM Inference Engineer

AnyscaleSan Francisco +1

Hybrid
Inference & ML systems

PyTorch
CUDA
TensorFlow
vLLM

$170K–$245K / yr

Posted May 27, 2026

Performance Engineer, Inference Systems

AnthropicSan Francisco, CA +2

Inference & ML systems
Visa sponsorship in the job text

Python
SQL
pandas

$350K–$850K / yr

Posted May 20, 2026

C

Inference Engine Development - Member of Technical Staff

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

vLLM

Pay not posted

Posted May 20, 2026

Member of Technical Staff - Inference

Sail ResearchSan Francisco

Onsite
Inference & ML systems
Member of Technical Staff

vLLM

$200K–$300K / yr

Posted May 18, 2026

RA

Software Engineer, Inference Infrastructure

Rhoda AIMountain View

Inference & ML systems
3+ years

AWS
Kubernetes
GCP
PyTorch
gRPC
+3 more

$175K–$280K / yr

Posted May 12, 2026

Go to the first page Show the next 40 jobs

JobsWithPay agent

Sign in to use it

Free in beta

Sign in to use the agent

The agent changes this search while you chat. It also compares pay, compares jobs with your résumé and saves jobs for you. All features are free while JobsWithPay is in beta.

Sign in for free