Search tech jobs | JobsWithPay

Jobs Ask AI Pay Interviews Companies CompareSign in

The jobs load…

We read every job from the company's own job board. You apply on the company site.Jobs Job types Internships New graduate jobs Companies Pay Reported pay Check an offer Add your pay Interview questions Add your interview questions Compare with LinkedIn Job sites compared Pay transparency laws API for developers Monthly report Companies we cover Make a portfolio page For companies: find people About Privacy

Filters (1)

Job typeSoftware engineering6ML / AI engineering159Inference & ML systems182Research14Product management17Solutions engineering3

LocationBay Area162New York35Remote (US)24Other places in the US48Outside the US25

LevelIntern2Entry level4Senior43Staff36Principal7Director+4

Work typeOnsite48Hybrid30Remote11

Minimum base payNo minimum$100K+190$150K+189$200K+176$250K+143$300K+104

Date postedAll datesLast 24 hours0Last 7 days8Last 30 days52

Years of experience0 to 2 years3 to 5 years6 to 9 years10 years or more

SkillsPythonAWSSQLTypeScriptKubernetesGCPAzureReactDockerJavaGoC++RustTerraformPyTorchSparkPostgreSQLJavaScriptNode.jsSwiftFigmaExcel

Other filtersOnly AI and ML jobsPosted payVisa sponsorship in the job textMember of Technical StaffOnly manager jobsHide jobs that we found on LinkedIn

203 jobs from 7,835 companies, checked on their job boards 5 h ago

Sort

“Inference”×Posted pay×Remove all filters

Email me new jobs like this

Tech jobs. With the words “inference”. Only jobs with posted pay.

Your email address

Website

One email each day, only when there are new jobs. No account is necessary. You can stop the emails with one click.

Senior/Staff Software Engineer, ML Inference Platform
NuroMountain View, California (HQ) +1
- Staff
- Inference & ML systems
- 3+ years
- Python
- C++
$194K–$352K / yr
Posted Aug 11, 2026
Machine Learning Performance Engineer (Inference)
Tower Research CapitalNew York
- Inference & ML systems
- 2+ years
- Python
- C++
- PyTorch
- FPGA
- JAX
$200K–$300K / yr
Posted Aug 11, 2026
Senior Technical Program Manager – LLM Inference
NebiusPalo Alto, California

+1

Senior
Product management

$147K–$224K / yr

Posted Aug 10, 2026

LS

Software Engineer, Inference Runtime

LM StudioNew York City

Hybrid
Inference & ML systems

Python
C++
PyTorch
CUDA
vLLM

$150K–$350K / yr

Posted Aug 7, 2026

Senior Product Manager - Inference Platform

NebiusRemote - United States +1

Senior
Remote
Product management

$228K–$285K / yr

Posted Aug 5, 2026

Research Engineer, Infrastructure, Inference

Thinking Machines LabSan Francisco

Onsite
Research
Visa sponsorship in the job text

Kubernetes
PyTorch
JAX
Ray
vLLM

$400K–$500K / yr

Posted Aug 4, 2026

Group Product Manager - Inference and Token Factory

VoltaPalo Alto, CA

Hybrid
Product management
Manager

$255K–$330K / yr

Posted Jul 28, 2026

DM

Principal System Software Engineer, AI Inference Execution

d-MatrixSanta Clara

Principal
Hybrid
Inference & ML systems
12+ years

Kubernetes
PyTorch
Ray
TensorFlow
vLLM

$195K–$285K / yr

Posted Jul 28, 2026

Staff Software Engineer- Foundation Model Inference

DatabricksSan Francisco, California +1

Staff
Inference & ML systems
8+ years

Azure
PyTorch
Databricks
MLflow
Ray
+1 more

$190K–$265K / yr

Posted Jul 24, 2026

Staff Engineer, Inference Optimizations

DigitalOceanAustin +5

Staff
Inference & ML systems
5+ years
5 positions

CUDA

$191K–$239K / yr

Posted Jul 23, 2026

Senior Machine Learning Engineer, LLM Inference Optimization

NebiusPalo Alto, California +1

Senior
Inference & ML systems

Python
PyTorch
CUDA
Ray
vLLM

$195K–$262K / yr

Posted Jul 22, 2026

Senior Applied Scientist, Efficient LLM Inference & Model Optimization

NebiusPalo Alto, California +1

Senior
Research

Python
PyTorch
CUDA
vLLM

$195K–$262K / yr

Posted Jul 22, 2026

Member of Technical Staff, Inference Systems

IncoBay Area HQ +1

Hybrid
Inference & ML systems
Member of Technical Staff

Python
Kubernetes
Go
C++
Rust
+3 more

$200K–$350K / yr

Posted Jul 22, 2026

Member of Technical Staff, Inference Research

IncoBay Area HQ +1

Onsite
Research
Member of Technical Staff

Python
Go
C++
Rust
PyTorch
+2 more

$200K–$350K / yr

Posted Jul 22, 2026

E

Inference Infrastructure Engineer, Serving

ElorianPalo Alto

Hybrid
Inference & ML systems
3+ years
Visa sponsorship in the job text

Python
C++
CUDA
vLLM

$200K–$400K / yr

Posted Jul 22, 2026

Sr. Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs, Annapurna Labs

Amazon.com Services LLCSeattle, Washington +1

Senior
Inference & ML systems
5+ years

AWS
C++
C
Linux

$168K–$262K / yr

Posted Jul 21, 2026

checked 2 days ago

[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering

Together AISan Francisco

Entry level
Inference & ML systems

Python
Kubernetes
Go
Rust
Ansible
+3 more

$160K–$280K / yr

Posted Jul 16, 2026

Senior Staff / Principal Machine Learning Scientist, AI Inference & Optimization

NetskopeSanta Clara, California +1

Principal
Inference & ML systems
10+ years

Python
C++
vLLM

$125K–$272K / yr

Posted Jul 14, 2026

Sr. Model Engineer, RL Inference

xAIPalo Alto, CA

Senior
Inference & ML systems

Python
C++
Rust
PyTorch
JAX
+1 more

$160K–$250K / yr

Posted Jul 6, 2026

Member of Technical Staff - Research, Inference

ModalNew York +1

Research
Member of Technical Staff

$150K–$350K / yr

Posted Jul 5, 2026

F

Staff AI Inference and Acceleration Engineer

FigureSan Jose, CA +1

Staff
Inference & ML systems
8+ years

Python
C++
CUDA
JAX

$180K–$275K / yr

Posted Jun 26, 2026

I

Member of Technical Staff, AMD GPU Kernel Engineering

InferactSan Francisco

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

PyTorch
CUDA
vLLM

$200K–$400K / yr

Posted Jun 26, 2026

I

Member of Technical Staff, TPU Kernel Engineering

InferactSingapore

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

PyTorch
CUDA
JAX
vLLM

SGD 200K–SGD 400K / yr

Posted Jun 26, 2026

I

Member of Technical Staff, AMD GPU Kernel Engineering

InferactSingapore

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

PyTorch
CUDA
vLLM

SGD 200K–SGD 400K / yr

Posted Jun 25, 2026

M

Member of Technical Staff, Inference

MirendilSan Francisco

Onsite
Inference & ML systems
Member of Technical Staff

$300K–$400K / yr

Posted Jun 24, 2026

I

Member of Technical Staff, Performance and Scale

InferactSingapore

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Go
C++
Rust

SGD 200K–SGD 400K / yr

Posted Jun 24, 2026

I

Member of Technical Staff, Inference

InferactSingapore

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Python
PyTorch
vLLM

SGD 200K–SGD 400K / yr

Posted Jun 24, 2026

I

Member of Technical Staff, Cloud Orchestration

InferactSingapore

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Python
AWS
Kubernetes
GCP
Azure
+5 more

SGD 200K–SGD 400K / yr

Posted Jun 24, 2026

I

Member of Technical Staff, Inference

InferactSan Francisco

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Python
PyTorch
vLLM

$200K–$400K / yr

Posted Jun 18, 2026

I

Member of Technical Staff, TPU Kernel Engineering

InferactSan Francisco

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

PyTorch
CUDA
JAX
vLLM

$200K–$400K / yr

Posted Jun 17, 2026

Staff+ Software Engineer, Inference Velocity

AnthropicRemote-Friendly (Travel-Required) +3

Staff
Remote
Inference & ML systems
8+ years
Visa sponsorship in the job text

AWS
CUDA

$405K–$485K / yr

Posted Jun 12, 2026

NL

Member of Technical Staff — Model Optimization and Inference (New Grad)

Nuance LabsSeattle, Washington +1

Entry level
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Python
PyTorch
CUDA
vLLM

$200K–$300K / yr

Posted Jun 11, 2026

Staff + Senior Software Engineer, Inference Infrastructure

AnthropicSan Francisco, CA +2

Staff
Inference & ML systems
Visa sponsorship in the job text

Python
AWS
Kubernetes
GCP
Azure
+1 more

$320K–$485K / yr

Posted Jun 8, 2026

NL

Member of Technical Staff — Model Optimization and Inference (Experienced)

Nuance LabsSeattle, Washington +1

Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Python
PyTorch
CUDA
vLLM

$250K–$350K / yr

Posted Jun 5, 2026

ML Engineer - Inference & Model Deployment

HiringCafeCupertino

Onsite
Inference & ML systems

vLLM

$250K–$310K / yr

Posted Jun 5, 2026

Inference Systems Engineer: Linux Kernel Test and Validation

CedanaRemote (US)

Remote
Inference & ML systems
5+ years

Kubernetes
Linux
vLLM

$180K / yr

Posted Jun 3, 2026

checked 2 days ago

Senior Director of Engineering - Inference Serving

SambaNovaSan Jose, California +1

Director+
Inference & ML systems
Manager
12+ years

Python
Kubernetes
Go
Rust

$245K–$325K / yr

Posted Jun 3, 2026

AI Research Engineer, Inference

Hudson River TradingLondon, United Kingdom +2

Research
2+ years

PyTorch
CUDA
FPGA
JAX

$250K–$300K / yr

Posted Jun 1, 2026

Distributed LLM Inference Engineer

AnyscaleSan Francisco +1

Hybrid
Inference & ML systems

PyTorch
CUDA
TensorFlow
vLLM

$170K–$245K / yr

Posted May 27, 2026

Performance Engineer, Inference Systems

AnthropicSan Francisco, CA +2

Inference & ML systems
Visa sponsorship in the job text

Python
SQL
pandas

$350K–$850K / yr

Posted May 20, 2026

Go to the first page Show the next 40 jobs

JobsWithPay agent

Sign in to use it

Free in beta

Sign in to use the agent

The agent changes this search while you chat. It also compares pay, compares jobs with your résumé and saves jobs for you. All features are free while JobsWithPay is in beta.

Sign in for free