Inference and ML systems engineer jobs in New York
Wait…
1,055 open inference and ML systems jobs in New York. We read every job from the company's own job board and check it every day.
How much do inference and ML systems jobs pay in New York?
The median posted base salary for inference and ML systems jobs in New York is $197K to $275K a year. This median comes from the 721 open jobs with posted pay. That is 68% of the 1,055 open jobs at 261 companies. For one in ten of these jobs, the top of the range is more than $405K. The numbers come from the companies' own job postings on November 10, 2026. We update them every day. They show base salary only, without stock or bonus.
Median posted base pay by company in New York
| Company | Jobs with posted pay | Median range |
|---|---|---|
| Aaru | 6 | $240K to $513K |
| Mercor | 2 | $170K to $500K |
| Anthropic | 55 | $350K to $485K |
| Roku | 2 | $195K to $408K |
| OpenAI | 9 | $230K to $405K |
| Perplexity | 9 | $220K to $405K |
Newest inference and ML systems jobs in New York
Staff Machine Learning Engineer
Altana Brooklyn, NY
$205K–$240K / yr
Posted today
Senior Staff Machine Learning Engineer
Altana Brooklyn, NY
$250K–$295K / yr
Posted today
Principal Solutions Specialist, Inference
CoreWeaveBellevue, WA / Dallas, TX / Livingston, NJ / Manhattan, NY / San Francisco, CA / Sunnyvale, CA +5
$177K–$237K / yr
Posted today
Research Engineer
PerceptaNew York City +1
$180K–$400K / yr
Posted today
Software Engineer, Photoreal 3D
MirageUnion Square, New York City
$175K–$300K / yr
Posted today