Search tech jobs | JobsWithPay

Jobs Ask AI Pay Interviews Companies CompareSign in

The jobs load…

We read every job from the company's own job board. You apply on the company site.Jobs Job types Internships New graduate jobs Companies Pay Reported pay Check an offer Add your pay Interview questions Add your interview questions Compare with LinkedIn Job sites compared Pay transparency laws API for developers Monthly report Companies we cover Make a portfolio page For companies: find people About Privacy

Filters

Job typeSoftware engineering8ML / AI engineering265Inference & ML systems305Research32Product management21Solutions engineering3Hardware and robotics1

LocationBay Area211New York38Remote (US)32Other places in the US61Remote (all countries)1Outside the US92India8Bengaluru7Mumbai1Chennai1Remote (India)1

LevelIntern11Entry level7Senior75Staff51Principal8Director+6

Work typeOnsite80Hybrid59Remote35

Minimum base payNo minimum$100K+190$150K+189$200K+176$250K+143$300K+104

Date postedAll datesLast 24 hours0Last 7 days15Last 30 days87

Years of experience0 to 2 years3 to 5 years6 to 9 years10 years or more

SkillsPythonAWSSQLTypeScriptKubernetesGCPAzureReactDockerJavaGoC++RustTerraformPyTorchSparkPostgreSQLJavaScriptNode.jsSwiftFigmaExcel

Other filtersOnly AI and ML jobsPosted payVisa sponsorship in the job textMember of Technical StaffOnly manager jobsHide jobs that we found on LinkedIn

335 jobs from 7,835 companies, checked on their job boards 4 h ago

Sort

“Inference”×Remove all filters

Email me new jobs like this

Tech jobs. With the words “inference”.

Your email address

Website

One email each day, only when there are new jobs. No account is necessary. You can stop the emails with one click.

[AI Frontier Div.] AI Inference Platform & Operations Engineer (5년 이상)
KRAFTONSeoul +1
- Inference & ML systems
Pay not posted
Posted 25 days ago
RA
Software Engineer Intern, Inference
Rhoda AIMountain View
- Intern
- Inference & ML systems
- Python
- C++
- PyTorch
- CUDA
Pay not posted
Posted 25 days ago
(Staff / Senior Staff) AI Inference Reliability Engineer, Compute Infra
Together AISan Francisco
- Staff
- Inference & ML systems
- Kubernetes
- CUDA
- Salesforce
$250K–$320K / yr
Posted 25 days ago

Senior Software Engineer, Private Cloud Compute Inference Routing

AppleCupertino, California +1

Senior
Onsite
Inference & ML systems
3+ years

Kubernetes
Java
Go
C++
Swift
+3 more

Pay not posted

Posted 26 days ago

checked 8 days ago

AI Inference Core - Senior SDET, Release Integration Testing

Cerebras SystemsSunnyvale, CA +1

Senior
Hybrid
Inference & ML systems

Python
Kubernetes
Go

Pay not posted

Posted 26 days ago

DU

Staff Applied Scientist, Experimentation and Causal Inference

DoorDash USACalifornia, CA +3

Staff
Research
6+ years

SQL

$194K–$285K / yr

Posted 29 days ago

Research Engineer - Inference

Prime IntellectSan Francisco +1

Research
Visa sponsorship in the job text

Python
PyTorch
CUDA
vLLM

$150K–$350K / yr

Posted 29 days ago

Staff Inference Engineer

UniphoreUSA - CA - Palo Alto

Staff
Inference & ML systems
5+ years

Python
C++
PyTorch
CUDA
Grafana
+2 more

$175K–$219K / yr

Posted Oct 16, 2026

checked 2 days ago

Z

Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud

ZyphraSan Francisco

Onsite
Inference & ML systems
Visa sponsorship in the job text

Python
AWS
Kubernetes
GCP
Azure
+9 more

Pay not posted

Posted Oct 15, 2026

DM

Senior Staff Inference Performance Engineer

d-MatrixSanta Clara +1

Staff
Hybrid
Inference & ML systems
8+ years

Python
Kubernetes
C++
Rust
C
+3 more

$175K–$265K / yr

Posted Oct 15, 2026

DM

Staff Test & Release Engineer, Inference Cloud

d-MatrixSanta Clara

Staff
Hybrid
Inference & ML systems
6+ years

Python
Kubernetes
Azure
Rust
Helm
+1 more

$155K–$235K / yr

Posted Oct 15, 2026

Senior/Staff Software Engineer (Back-End), Inference

CohereCanada +6

Staff
Remote
Inference & ML systems

Python
Java
Go
C++
Rust

$205K–$315K / yr

Posted Oct 15, 2026

G

Member of Technical Staff - Inference

GhostSan Francisco

Onsite
Inference & ML systems
Member of Technical Staff

Python
C++
CUDA

Pay not posted

Posted Oct 15, 2026

Technical Program Manager, Inference

AnthropicSan Francisco, CA +2

Product management
7+ years
Visa sponsorship in the job text

$290K–$435K / yr

Posted Oct 15, 2026

T

Working Student - LLM Quantization & Inference Performance

TensordyneMunich, Germany +1

Intern
Inference & ML systems

Python
PyTorch

Pay not posted

Posted Oct 14, 2026

Research Scientist - Decentralized Training and Inference Verification

Pluralis ResearchSan Francisco +1

Remote
Research
Visa sponsorship in the job text

Pay not posted

Posted Oct 14, 2026

Research Scientist - Geo-Distributed Inference

Pluralis ResearchSan Francisco +1

Remote
Research
Visa sponsorship in the job text

Pay not posted

Posted Oct 14, 2026

I

Engineering Manager

InferactSan Francisco

Onsite
Software engineering
Manager
2+ years
Visa sponsorship in the job text

Kubernetes
PyTorch
CUDA
vLLM

$200K–$400K / yr

Posted Oct 14, 2026

VP Product, Cloud & Inference

Mistral AIParis +2

Director+
Hybrid
Inference & ML systems
Manager

Pay not posted

Posted Oct 14, 2026

Principal Engineer: Annapurna Labs Training and Inference , Annapurna Labs, AWS Neuron SDK

Annapurna Labs (U.S.) Inc.Seattle, Washington +1

Principal
Inference & ML systems

AWS
JAX

$200K–$311K / yr

Posted Oct 14, 2026

checked 2 days ago

Engineering Manager, Inference Router

Cerebras SystemsSunnyvale, CA +1

Hybrid
Inference & ML systems
Manager
8+ years

Kubernetes
C++
vLLM

Pay not posted

Posted Oct 13, 2026

Software Engineer II - AI/ML, Neuron Inference, Inference

Annapurna Labs (U.S.) Inc.Cupertino, California

Inference & ML systems

Python
AWS
PyTorch

$165K–$224K / yr

Posted Oct 13, 2026

checked 2 days ago

ML Systems Research Engineer, RL / Inference / Agent Systems

Advanced Micro Devices, IncSanta Clara, California

Onsite
Research

Python
Kubernetes
PyTorch
CUDA
JAX
+2 more

Pay not posted

Posted Oct 12, 2026

checked 2 days ago

Staff Product Manager, AI Inference

CoreWeaveBellevue, WA / Sunnyvale, CA +2

Staff
Product management
8+ years

Kubernetes
vLLM

$207K–$275K / yr

Posted Oct 12, 2026

Senior Applied Scientist, Efficient LLM Inference & Model Optimization

NebiusLondon, United Kingdom +7

Senior
Remote
Research
4 positions

Python
PyTorch
CUDA
vLLM

Pay not posted

Posted Oct 12, 2026

L

Forward Deployed Engineer AI Inference

Onsite
Inference & ML systems
4+ years

vLLM

Pay not posted

Posted Oct 9, 2026

AI Engineer 5 (FM Hosting, LLM Inference)

Capital OneNew York, NY +4

Inference & ML systems
6+ years
2 positions
Visa sponsorship in the job text

Python
AWS
GCP
Azure
Java
+7 more

$230K–$286K / yr

Posted Oct 9, 2026

checked 2 days ago

Machine Learning Engineer - Inference Maintainer & Developer Experience

RoboflowSan Francisco, California +2

Remote
Inference & ML systems
5+ years
2 positions

PyTorch
TensorFlow
vLLM

$155K–$180K / yr

Posted Oct 8, 2026

checked 2 days ago

Principal Engineer, Inference Memory and Storage Systems

DigitalOceanSeattle +1

Principal
Inference & ML systems
15+ years

vLLM

$250K–$312K / yr

Posted Oct 8, 2026

H

Inference Optimization Engineer

HedraSan Francisco

Inference & ML systems

Python
C++
PyTorch
CUDA
vLLM

Pay not posted

Posted Oct 8, 2026

PG

Staff Software Engineer, Console GPU Inference

PlayStation GlobalUnited Kingdom, London +1

Staff
Inference & ML systems
10+ years

C++
C

Pay not posted

Posted Oct 8, 2026

L

Forward Deployed Engineer – AI Inference (Intern)

LyceumBerlin

Intern
Onsite
Inference & ML systems

vLLM

Pay not posted

Posted Oct 8, 2026

F

Forward Deployed Engineer - AI Inference

FriendliAISan Francisco

Hybrid
Inference & ML systems
3+ years

AWS
Kubernetes
GCP
Docker
Terraform
+4 more

Pay not posted

Posted Oct 7, 2026

LLM Inference Systems Engineer

Hippocratic AIMenlo Park, CA

Onsite
Inference & ML systems

Python
Kubernetes
C++
CUDA
vLLM

Pay not posted

Posted Oct 7, 2026

Engineering Manager, Inference Performance

BasetenSan Francisco +1

Hybrid
Inference & ML systems
Manager

PyTorch
CUDA
vLLM

$240K–$270K / yr

Posted Oct 7, 2026

Senior Java Software Engineer - Search Inference - Platform

ElasticPortugal +1

Senior
Inference & ML systems
5+ years

Java

€56K–€88K / yr

Posted Oct 6, 2026

Senior Java Software Engineer - Search Inference - Platform

ElasticGreece +1

Senior
Inference & ML systems
5+ years

Java

€61K–€97K / yr

Posted Oct 6, 2026

Senior Java Software Engineer - Search Inference - Platform

ElasticSpain +1

Senior
Inference & ML systems
5+ years

Java

€67K–€106K / yr

Posted Oct 6, 2026

Senior Java Software Engineer - Search Inference - Platform

ElasticIreland +1

Senior
Inference & ML systems
5+ years

Java

€87K–€138K / yr

Posted Oct 6, 2026

Senior Java Software Engineer - Search Inference - Platform

ElasticUnited Kingdom

Senior
Inference & ML systems
5+ years

Java
Elasticsearch

Pay not posted

Posted Oct 6, 2026

Go to the first page Show the next 40 jobs

JobsWithPay agent

Sign in to use it

Free in beta

Sign in to use the agent

The agent changes this search while you chat. It also compares pay, compares jobs with your résumé and saves jobs for you. All features are free while JobsWithPay is in beta.

Sign in for free