Software Engineer, Inference Systems

River AI Inc.Palo Alto, CA +1

• Inference & ML systems
• Visa sponsorship in the job text

• Python
• C++
• Rust
• CUDA
• vLLM

Senior/Sr. Staff AI Infrastructure Engineer, Inference & Optimization

DiDi LabsSan Jose, CA +1

• Staff
• Inference & ML systems
• 3+ years

• Python
• C++
• PyTorch
• CUDA
• vLLM

Sr. Software Development Engineer, Inference Team - AWS Neuron

Annapurna Labs (U.S.) Inc.Seattle, Washington

• Senior
• Inference & ML systems

• AWS
• vLLM

Software Engineer, AI Infrastructure - LVM Inference & Evaluation

Ambient.aiRedwood City

• Hybrid
• Inference & ML systems
• 2+ years

• Python
• PyTorch
• CUDA
• vLLM

2027 Internship Onboard Infrastructure Engineer, ML Inference

Bedrock Robotics IncSan Francisco, CA

• Intern
• Onsite
• Inference & ML systems

• C++
• Rust
• PyTorch
• CUDA
• JAX
• +1 more

Research Scientist - Information Theory and Statistical Inference

EvolverPalo Alto, California +1

• Research

• Python
• MATLAB

Technical Director, Large-Scale AI Model Inferencing

Samsung SemiconductorSan Jose, California +1

• Director+
• Software engineering
• Manager
• 12+ years

• C++
• PyTorch
• CUDA
• vLLM

Staff GPU Inference SDET

Cerebras SystemsSunnyvale, CA +1

• Staff
• Hybrid
• Inference & ML systems
• 8+ years

• C++
• PyTorch

Staff+ Software Engineer, ML Inference Path

AnthropicSan Francisco, CA

• Staff
• Inference & ML systems
• 5+ years
• Visa sponsorship in the job text

• Python
• PyTorch
• A/B testing
• JAX
• TensorFlow

Staff Applied AI Inference Engineer

CrusoeSan Francisco, CA - US

• Staff
• Onsite
• Inference & ML systems

• Python
• Kubernetes
• Docker
• C++
• CUDA
• +1 more

Member of Technical Staff, Inference

InferactRemote

• Inference & ML systems
• Member of Technical Staff
• Visa sponsorship in the job text

• Python
• PyTorch
• vLLM

AI Inference Core - Technical Lead Manager, Release Qual & Integration

Cerebras SystemsSunnyvale, CA +1

• Senior
• Hybrid
• Inference & ML systems
• Manager

• Python

Engineering Manager, Inference Infrastructure

AnthropicSan Francisco, CA +2

• Inference & ML systems
• Manager
• Visa sponsorship in the job text

• Kubernetes

Research Engineer - Decentralized Training and Inference Verification

Pluralis ResearchSan Francisco +1

• Remote
• Research
• Visa sponsorship in the job text

Research Engineer - Geo-Distributed Inference

Pluralis ResearchSan Francisco +1

• Remote
• Research
• Visa sponsorship in the job text

ML Engineer, Inference Optimization

BuildSan Francisco

• Onsite
• Inference & ML systems

• Python
• C++
• Rust
• PyTorch
• CUDA
• +1 more

Research Engineer - Inference

ElevenLabsUnited Kingdom +3

• Remote
• Research

• CUDA
• vLLM

Senior Inference Engineer, AGI

Amazon.com Services LLCBoston, Massachusetts +2

• Senior
• Inference & ML systems
• 6+ years

• Python
• AWS
• Java
• C++
• PyTorch
• +5 more

Member of Technical Staff, Cloud Orchestration (Remote)

InferactRemote

• Inference & ML systems
• Member of Technical Staff
• Visa sponsorship in the job text

• Python
• AWS
• Kubernetes
• GCP
• Azure
• +5 more

Distributed Training and Inference Engineer

SciforiumSan Francisco, CA

• Onsite
• Inference & ML systems
• 5+ years

• Python
• C++
• PyTorch
• CUDA
• JAX
• +1 more

Member of Technical Staff, Supercomputing Infrastructure

InferactSan Francisco

• Onsite
• Inference & ML systems
• Member of Technical Staff
• Visa sponsorship in the job text

• Python
• Kubernetes
• Terraform
• Ansible
• Bash
• +2 more

Staff Software Engineer, Inference / Compute Infrastructure Engineering London or Amsterdam

Together AILondon & Amsterdam +1

• Staff
• Inference & ML systems

• Python
• Kubernetes
• Go
• Rust
• Ansible
• +3 more

Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering

Together AIIndia +2

• Staff
• Remote
• Inference & ML systems
• 2 positions

• Python
• Kubernetes
• Go
• Rust
• Ansible
• +3 more

Software Engineer, Inference (AI Data Engineering)

SpaceXPalo Alto, CA

• Inference & ML systems
• 2+ years

• Python
• Kubernetes
• Docker
• Go
• C++
• +6 more

Staff Machine Learning Scientist, Applied Causal Inference

DoorDash USASan Francisco, CA +4

• Staff
• Inference & ML systems

Staff Machine Learning Engineer, Causal Inference

DoorDash USASan Francisco, CA +4

• Staff
• Inference & ML systems

Senior Staff LLM Inference Engineer

d-MatrixSanta Clara

• Staff
• Hybrid
• Inference & ML systems
• 10+ years

• Python
• C++
• C
• CUDA
• JAX
• +1 more

Member of Research Staff, Causal Inference, Voleon Securities

The Voleon GroupNew York City, NY +2

• Staff
• Hybrid
• Research

• Python

Staff + Senior Software Engineer, Inference

AnthropicOntario, CAN +1

• Staff
• Inference & ML systems
• Visa sponsorship in the job text

• Python
• Rust

ML Systems Engineer — Inference Acceleration

AragoParis Offices

• Onsite
• Inference & ML systems

• Python
• C++
• CUDA
• vLLM

Software Engineer, ML Inference Platform

NuroMountain View, California (HQ) +1

• Inference & ML systems
• 1+ years

• Python
• C++

Senior/Staff Software Engineer, ML Inference Platform

NuroMountain View, California (HQ) +1

• Staff
• Inference & ML systems
• 3+ years

• Python
• C++

Machine Learning Performance Engineer (Inference)

Tower Research CapitalNew York

• Inference & ML systems
• 2+ years

• Python
• C++
• PyTorch
• FPGA
• JAX

Performance Engineer, Inference

SarvamBengaluru +1

• Onsite
• Inference & ML systems
• 5+ years

• C++
• CUDA
• vLLM

Software Engineer, Inference Runtime

LM StudioNew York City

• Hybrid
• Inference & ML systems

• Python
• C++
• PyTorch
• CUDA
• vLLM

Staff Software Engineer, Inference

CoreWeave EuropeLondon, England +2

• Staff
• Inference & ML systems
• 8+ years
• 2 positions

• Python
• Kubernetes
• Go
• C++
• CUDA
• +2 more

Forward Deployed Engineer (Inference & Post-Training) - Mandarin Speaking

Together AISingapore +1

• Remote
• Inference & ML systems
• 5+ years

• Python
• Salesforce
• vLLM