Senior Technical Program Manager – LLM Inference

NebiusPalo Alto, California +1

• Senior
• Product management

Performance Engineer, Inference

SarvamBengaluru +1

• Onsite
• Inference & ML systems
• 5+ years

• C++
• CUDA
• vLLM

Software Engineer, Inference Runtime

LM StudioNew York City

• Hybrid
• Inference & ML systems

• Python
• C++
• PyTorch
• CUDA
• vLLM

Engineering Manager, Inference

Mistral AINew York

• Hybrid
• Inference & ML systems
• Manager

• Python
• TypeScript
• Go
• C#
• Django
• +2 more

Staff Software Engineer, Inference

CoreWeave EuropeLondon, England +2

• Staff
• Inference & ML systems
• 8+ years
• 2 positions

• Python
• Kubernetes
• Go
• C++
• CUDA
• +2 more

Senior Product Manager - Inference Platform

NebiusRemote - United States +1

• Senior
• Remote
• Product management

Forward Deployed Engineer (Inference & Post-Training) - Mandarin Speaking

Together AISingapore +1

• Remote
• Inference & ML systems
• 5+ years

• Python
• Salesforce
• vLLM

Research Engineer, Infrastructure, Inference

Thinking Machines LabSan Francisco

• Onsite
• Research
• Visa sponsorship in the job text

• Kubernetes
• PyTorch
• JAX
• Ray
• vLLM

Member of Technical Staff (Inference)

Artificial AnalysisSan Francisco (On-site)

• Onsite
• Inference & ML systems
• Member of Technical Staff
• 3+ years

• Python
• vLLM

Group Product Manager - Inference and Token Factory

VoltaPalo Alto, CA

• Hybrid
• Product management
• Manager

Principal System Software Engineer, AI Inference Execution

d-MatrixSanta Clara

• Principal
• Hybrid
• Inference & ML systems
• 12+ years

• Kubernetes
• PyTorch
• Ray
• TensorFlow
• vLLM

Data Scientist - Measurement, Experimentation & Causal Inference

PlayStation GlobalUnited Kingdom, London +1

• Inference & ML systems
• 3+ years

• Python
• SQL
• A/B testing
• Airflow
• Databricks
• +3 more

Staff Software Engineer- Foundation Model Inference

DatabricksSan Francisco, California +1

• Staff
• Inference & ML systems
• 8+ years

• Azure
• PyTorch
• Databricks
• MLflow
• Ray
• +1 more

Staff Engineer, Inference Optimizations

DigitalOceanAustin +5

• Staff
• Inference & ML systems
• 5+ years
• 5 positions

• CUDA

Director/Sr. Manager, AI Inference Model Scaling

Cerebras SystemsSunnyvale, CA

• Director+
• Hybrid
• Inference & ML systems
• Manager
• 12+ years

• Python
• C++
• PyTorch
• JAX
• TensorFlow

Senior Machine Learning Engineer, LLM Inference Optimization

NebiusPalo Alto, California +1

• Senior
• Inference & ML systems

• Python
• PyTorch
• CUDA
• Ray
• vLLM

Senior Applied Scientist, Efficient LLM Inference & Model Optimization

NebiusPalo Alto, California +1

• Senior
• Research

• Python
• PyTorch
• CUDA
• vLLM

Member of Technical Staff, Inference Systems

IncoBay Area HQ +1

• Hybrid
• Inference & ML systems
• Member of Technical Staff

• Python
• Kubernetes
• Go
• C++
• Rust
• +3 more

Member of Technical Staff, Inference Research

IncoBay Area HQ +1

• Onsite
• Research
• Member of Technical Staff

• Python
• Go
• C++
• Rust
• PyTorch
• +2 more

Inference Infrastructure Engineer, Serving

ElorianPalo Alto

• Hybrid
• Inference & ML systems
• 3+ years
• Visa sponsorship in the job text

• Python
• C++
• CUDA
• vLLM

Member of Technical Staff – AI Inference platform, features

LyceumZürich

• Onsite
• Inference & ML systems
• Member of Technical Staff
• 3+ years

• Python
• Kubernetes
• Go
• gRPC
• vLLM

Member of Technical Staff – AI Inference platform

LyceumZürich

• Onsite
• Inference & ML systems
• Member of Technical Staff
• 3+ years

• Python
• Kubernetes
• Go
• Grafana
• Prometheus
• +1 more

Sr. Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs, Annapurna Labs

Amazon.com Services LLCSeattle, Washington +1

• Senior
• Inference & ML systems
• 5+ years

• AWS
• C++
• C
• Linux

Member of Technical Staff — Inference Infrastructure

Causal LabsSan Francisco +1

• Onsite
• Inference & ML systems
• Member of Technical Staff

• Kubernetes
• PyTorch
• JAX
• Ray
• vLLM

[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering

Together AISan Francisco

• Entry level
• Inference & ML systems

• Python
• Kubernetes
• Go
• Rust
• Ansible
• +3 more

Senior Technical Product Manager - Inference Platform

NebiusAmsterdam, Netherlands +3

• Senior
• Remote
• Product management

Member of Engineering (Inference Infrastructure)

PoolsideRemote (EMEA)

• Remote
• Inference & ML systems

• Kubernetes
• Go

Senior Staff / Principal Machine Learning Scientist, AI Inference & Optimization

NetskopeSanta Clara, California +1

• Principal
• Inference & ML systems
• 10+ years

• Python
• C++
• vLLM

Senior SDET, Inference Platform

Cerebras SystemsSunnyvale, CA +1

• Senior
• Hybrid
• Inference & ML systems
• 3+ years

• Python
• Kubernetes

Sr. Model Engineer, RL Inference

xAIPalo Alto, CA

• Senior
• Inference & ML systems

• Python
• C++
• Rust
• PyTorch
• JAX
• +1 more

LLM Inference Engineer

Near AISan Francisco or Remote +1

• Remote
• Inference & ML systems

• PyTorch
• CUDA
• vLLM

Member of Technical Staff - Research, Inference

ModalNew York +1

• Research
• Member of Technical Staff

Senior Inference ML API SDET

Cerebras SystemsSunnyvale, CA +1

• Senior
• Onsite
• Inference & ML systems
• 5+ years

• Python
• Go
• C++

Staff AI Inference and Acceleration Engineer

FigureSan Jose, CA +1

• Staff
• Inference & ML systems
• 8+ years

• Python
• C++
• CUDA
• JAX

Member of Technical Staff, AMD GPU Kernel Engineering

InferactSan Francisco

• Onsite
• Inference & ML systems
• Member of Technical Staff
• Visa sponsorship in the job text

• PyTorch
• CUDA
• vLLM

Member of Technical Staff, TPU Kernel Engineering

InferactSingapore

• Onsite
• Inference & ML systems
• Member of Technical Staff
• Visa sponsorship in the job text

• PyTorch
• CUDA
• JAX
• vLLM

Member of Technical Staff, AMD GPU Kernel Engineering

InferactSingapore

• Onsite
• Inference & ML systems
• Member of Technical Staff
• Visa sponsorship in the job text

• PyTorch
• CUDA
• vLLM