Search tech jobs | JobsWithPay

Jobs Ask AI Pay Interviews Companies CompareSign in

The jobs load…

We read every job from the company's own job board. You apply on the company site.Jobs Job types Internships New graduate jobs Companies Pay Reported pay Check an offer Add your pay Interview questions Add your interview questions Compare with LinkedIn Job sites compared Pay transparency laws API for developers Monthly report Companies we cover Make a portfolio page For companies: find people About Privacy

JobsWithPay agent

Sign in to use it

Free in beta

Sign in to use the agent

The agent changes this search while you chat. It also compares pay, compares jobs with your résumé and saves jobs for you. All features are free while JobsWithPay is in beta.

Sign in for free

Examples: Remote senior ML jobs that pay $200K or more New graduate software jobs in New York with visa sponsorship Data engineer jobs in Bengaluru that use Spark

Filters (2)

Job typeSoftware engineering3,100ML / AI engineering1,681Inference & ML systems1,007Research449Infra, platform & SRE950Data engineering205Data science226Security engineering371Product management1,140Design506Quant and trading219Solutions engineering474Hardware and robotics98Data and business analysis223

LocationBay Area4,141New York1,007Remote (US)1,019Other places in the US2,511Remote (all countries)19Outside the US2,370India471Bengaluru326Hyderabad83Delhi NCR50Mumbai23Pune51Chennai24Remote (India)43

LevelIntern30Entry level15Senior184Staff113Principal27Director+40

Work typeOnsite256Hybrid164Remote2

Minimum base payNo minimum$100K+849$150K+843$200K+782$250K+576$300K+365

Date postedAll datesLast 24 hours0Last 7 days36Last 30 days236

Years of experience0 to 2 years3 to 5 years6 to 9 years10 years or more

SkillsPythonAWSSQLTypeScriptKubernetesGCPAzureReactDockerJavaGoC++RustTerraformPyTorchSparkPostgreSQLJavaScriptNode.jsSwiftFigmaExcel

Other filtersOnly AI and ML jobsPosted payVisa sponsorship in the job textMember of Technical StaffOnly manager jobsHide jobs that we found on LinkedIn

1,007 jobs from 7,867 companies, checked on their job boards 1 h ago

Sort

Inference & ML systems×New York×Remove all filters

Email me new jobs like this

Inference & ML systems jobs in New York.

Your email address

Website

One email each day, only when there are new jobs. No account is necessary. You can stop the emails with one click.

Software Engineer - AI Developer Productivity
BasetenSan Francisco +4
- Hybrid
- Software engineering
- 4+ years
- Python
- Kubernetes
- Docker
$165K–$330K / yr
Posted Aug 11, 2026
Engineering Manager, Artifacts & Registry - W&B
CoreWeaveLivingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA +5
- Software engineering
- Manager
- 5+ years
- Azure
- Go
- ClickHouse
$165K–$242K / yr
Posted Aug 11, 2026
Engineering Manager, Artifacts & Registry - W&B

Weights & Biases

Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA +5

Software engineering
Manager
5+ years

Azure
Go
ClickHouse

$165K–$242K / yr

Posted Aug 11, 2026

checked 6 days ago

Software Engineer - Testing Frameworks

BasetenSan Francisco +4

Hybrid
Software engineering

Python
Kubernetes
Docker
Go

$165K–$330K / yr

Posted Aug 11, 2026

Software Engineer - Continuous Delivery

BasetenSan Francisco +4

Hybrid
Software engineering

Python
Kubernetes
Go

$165K–$330K / yr

Posted Aug 11, 2026

Compute Engineer, Deployment

FluidstackNew York, NY +4

Hybrid
Infra, platform & SRE

Python
Go
Linux

$164K–$206K / yr

Posted Aug 11, 2026

AI Infrastructure Operations, Demand Planning

AnthropicSan Francisco, CA +1

ML / AI engineering
Visa sponsorship in the job text

Python
SQL

$320K–$405K / yr

Posted Aug 11, 2026

Infrastructure Capacity Planner, Demand Planning

AnthropicSan Francisco, CA +1

Infra, platform & SRE
Visa sponsorship in the job text

Python
SQL
pandas

$320K–$405K / yr

Posted Aug 11, 2026

HPC Operations Engineer

Tower Research CapitalNew York

Inference & ML systems
2+ years

Python
Ansible
Bash
Grafana
Linux
+1 more

$175K–$225K / yr

Posted Aug 11, 2026

Software Engineer, Machine Lifecycle

Tower Research CapitalNew York

Software engineering

Python
Ansible
Linux

$150K–$250K / yr

Posted Aug 11, 2026

GPU Systems Engineer

Tower Research CapitalNew York

Inference & ML systems
5+ years

Python
C++
Ansible
C
CUDA
+1 more

$200K–$300K / yr

Posted Aug 11, 2026

Software Engineer, GPU Fleet

Tower Research CapitalNew York

Inference & ML systems
2+ years

Python
Linux

$200K–$300K / yr

Posted Aug 11, 2026

Machine Learning Performance Engineer (Inference)

Tower Research CapitalNew York

Inference & ML systems
2+ years

Python
C++
PyTorch
FPGA
JAX

$200K–$300K / yr

Posted Aug 11, 2026

Machine Learning Research Engineer

Tower Research CapitalNew York

Research

Python
PyTorch
Ray
TensorFlow

$200K–$300K / yr

Posted Aug 11, 2026

Member of Technical Staff, Bayesian Statistics

Ataraxis AINew York HQ

Inference & ML systems
Member of Technical Staff

Python
PyTorch

$100K–$300K / yr

Posted Aug 10, 2026

Member of Technical Staff, Causality

Ataraxis AINew York HQ

Inference & ML systems
Member of Technical Staff

Python
PyTorch

$100K–$300K / yr

Posted Aug 10, 2026

Member of Technical Staff, Survival Analysis

Ataraxis AINew York HQ

Inference & ML systems
Member of Technical Staff

Python
PyTorch

$100K–$300K / yr

Posted Aug 10, 2026

Software Engineer - Observability

BasetenSan Francisco +4

Hybrid
Software engineering

Python
Go
Rust
ClickHouse
Grafana
+1 more

$165K–$330K / yr

Posted Aug 10, 2026

Senior Product Engineer

AxleNew York City

Senior
Onsite
Software engineering
3+ years

$160K–$215K / yr

Posted Aug 10, 2026

Member of the Technical Staff — AI/ML

StuutSan Francisco +1

Onsite
ML / AI engineering
Member of Technical Staff
5+ years

Python
PyTorch
A/B testing
LangChain
scikit-learn
+1 more

$220K–$350K / yr

Posted Aug 10, 2026

Member of Technical Staff - Post-Training

ReflectionSan Francisco, CA +2

Onsite
Inference & ML systems
Member of Technical Staff
Visa sponsorship in the job text

Pay not posted

Posted Aug 10, 2026

Applied Scientist, Amazon Connect

Amazon Web Services, Inc.New York, New York

Research

$172K–$223K / yr

Posted Aug 10, 2026

checked 2 days ago

Compiler Architect, MTIA Software (Technical Leadership)

MetaMenlo Park, California +1

Onsite
Inference & ML systems
12+ years

C++
PyTorch

$219K–$301K / yr

Posted Aug 9, 2026

checked 9 days ago

LS

Software Engineer, Inference Runtime

LM StudioNew York City

Hybrid
Inference & ML systems

Python
C++
PyTorch
CUDA
vLLM

$150K–$350K / yr

Posted Aug 7, 2026

LA

Senior Software Engineer, Training & Experimentation

Lightning AILondon, England, United Kingdom +3

Senior
Software engineering

Python
AWS
Kubernetes
GCP
Azure
+3 more

$180K–$250K / yr

Posted Aug 7, 2026

LA

Senior Software Engineer, Agents

Lightning AILondon, England, United Kingdom +3

Senior
Software engineering

Python
AWS
Kubernetes
GCP
Azure
+3 more

$180K–$250K / yr

Posted Aug 7, 2026

Member of Technical Staff, Enterprise Foundations

Fireworks AINew York

Hybrid
Inference & ML systems
Member of Technical Staff
4+ years

Python
AWS
TypeScript
Kubernetes
GCP
+4 more

$165K–$240K / yr

Posted Aug 7, 2026

N

Director, HPC Systems Software Engineering

NscaleHouston +3

Director+
Inference & ML systems
Manager

$230K–$343K / yr

Posted Aug 6, 2026

Engineering Manager, Inference

Mistral AINew York

Hybrid
Inference & ML systems
Manager

Python
TypeScript
Go
C#
Django
+2 more

Pay not posted

Posted Aug 6, 2026

Applied Scientist, Amazon Connect

Amazon Development Center U.S., Inc.New York, New York

Research

$172K–$223K / yr

Posted Aug 6, 2026

checked 2 days ago

A

Member of Technical Staff (Data Platform)

ATGNew York City +1

Hybrid
Inference & ML systems
Member of Technical Staff

Python
SQL

$150K–$275K / yr

Posted Aug 4, 2026

Software Engineer, Systems Generalist

Thinking Machines LabSan Francisco +1

Onsite
Software engineering
Visa sponsorship in the job text

Python
Kubernetes
Rust

$300K–$400K / yr

Posted Aug 4, 2026

Forward Deployed AI Engineer

Indicium AINew York, NY +1

ML / AI engineering
5+ years

SQL
Spark
Databricks

$180K–$240K / yr

Posted Aug 4, 2026

Senior Manager, Technical Operations

DDNNew York Office +1

Senior
Hybrid
Software engineering
Manager
7+ years

Salesforce

$155K–$195K / yr

Posted Aug 4, 2026

Infrastructure Engineer

Prior LabsBerlin +2

Onsite
Infra, platform & SRE
3+ years

Python
AWS
Kubernetes
GCP
Azure
+4 more

Pay not posted

Posted Aug 4, 2026

Senior Software Architect

KitwareClifton Park, New York +3

Senior
Onsite
Software engineering
5+ years
2 positions

Python
C++
Linux

$140K–$190K / yr

Posted Aug 3, 2026

Applied Scientist

Mistral AIPalo Alto +1

Hybrid
Research

Python
PyTorch
JAX

Pay not posted

Posted Aug 3, 2026

Engineering Manager, Search

AnthropicSan Francisco, CA +1

Software engineering
Manager
Visa sponsorship in the job text

$320K–$405K / yr

Posted Aug 3, 2026

Member of Technical Staff, AI Training Infrastructure

Fireworks AISan Mateo +3

Hybrid
Inference & ML systems
Member of Technical Staff
3+ years

AWS
Kubernetes
GCP
Azure
Docker
+1 more

$210K–$320K / yr

Posted Jul 31, 2026

Principal Data Scientist

Blink HealthNew York, NY +1

Principal
Data science
10+ years

Python
SQL
Databricks
MLflow
R
+1 more

Pay not posted

Posted Jul 31, 2026

Go to the first page Show the next 40 jobs