Backend: AI Infra and GPU Orchestration

CHAI AI, Palo Alto, CA

What you will do

Model serving and inference infrastructure
GPU scheduling and orchestration across providers
Scaling, reliability and cost efficiency

Tech stack

Python
vLLM / SGLang
Docker
Kubernetes

Read the job posting on the CHAI AI site

Similar jobs at other companies

Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering
Together AIIndia +1
- Staff
- Remote
- Inference & ML systems
- 2 positions
Pay not posted
Posted Aug 19, 2026
C
Backend Developer (AI)
CygnifySingapore
- Onsite
- Software engineering
Pay not posted
Posted Aug 18, 2026
A
Member of Technical Staff - Inference
ai&Yokohama +1
- Hybrid
- Inference & ML systems
- Member of Technical Staff
Pay not posted
Posted Mar 20, 2026

All jobs

Backend: AI Infra and GPU Orchestration

CHAI AI, Palo Alto, CA

Posted pay

Pay not posted

Location: Palo Alto, CA
Work type: Not given
Level: Not given
Skills in the job text: Python
Kubernetes
Docker
vLLM
Posted: Not given
Last check: 2 days ago
Job type: Inference & ML systems, ML / AI engineering

Apply on the CHAI AI site Make a résumé and a cover letter for this job Sign in to save

The CHAI AI site opens in a new tab.

CHAI AI

Open tech jobs: 4
With posted pay: 0%

About CHAI AI: funding, hiring and pay

CHAI AI

About CHAI AI: funding, hiring and pay

Interview questions

No one has reported an interview at CHAI AI yet. Did you interview there? Add the questions.

Check my fit

Compare your résumé with this job. See where you match, what is missing and which lines to change.

Make a résumé and a cover letter for this job

Paste your résumé, or use the résumé on your profile.
Get the résumé as a PDF and the letter as text. We use only the facts in your résumé.
Apply on the CHAI AI site.

Open the apply kit

What you will do

Model serving and inference infrastructure
GPU scheduling and orchestration across providers
Scaling, reliability and cost efficiency

Tech stack

Python
vLLM / SGLang
Docker
Kubernetes

Read the job posting on the CHAI AI site

Similar jobs at other companies

Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering
Together AIIndia +1
- Staff
- Remote
- Inference & ML systems
- 2 positions
Pay not posted
Posted Aug 19, 2026
C
Backend Developer (AI)
CygnifySingapore
- Onsite
- Software engineering
Pay not posted
Posted Aug 18, 2026
A
Member of Technical Staff - Inference
ai&Yokohama +1
- Hybrid
- Inference & ML systems
- Member of Technical Staff
Pay not posted
Posted Mar 20, 2026

Backend: AI Infra and GPU Orchestration

What you will do

Tech stack

Similar jobs at other companies

Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering

Backend Developer (AI)

Member of Technical Staff - Inference

Backend: AI Infra and GPU Orchestration

What you will do

Tech stack

Similar jobs at other companies

Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering

Backend Developer (AI)

Member of Technical Staff - Inference

Software Developer 5 , AI Infrastructure

(Staff / Senior Staff) AI Inference Reliability Engineer, Compute Infra

[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering

Interview questions

CHAI AI