This role sits at the boundary between model execution and distributed infrastructure. You will work on systems that determine inference latency, throughput, stability, and the reliability of RL and post-training training loops.
Magic’s long-context models introduce demanding execution constraints: KV-cache scaling, memory pressure under long sequences, batching trade-offs, long-horizon trajectory rollouts, and sustained throughput under real-world workloads. You will own the infrastructure that makes both production inference and large-scale RL iteration fast and reliable.
Magic’s mission is to build safe AGI that accelerates humanity’s progress on the world’s most important problems. We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than humans can alone. Our approach combines frontier-scale pretraining, domain-specific RL, ultra-long context, and inference-time compute to achieve this goal.
Magic strives to be the place where high-potential individuals can do their best work. We value quick learning and grit just as much as skill and experience.
Thinking Machines LabSan Francisco
$350K–$475K / yr
Posted Aug 21, 2026
$150K–$450K / yr
Posted Oct 5, 2026
Advanced Micro Devices, IncSanta Clara, California
Pay not posted
Posted Oct 12, 2026
checked 2 days agoIncoBay Area HQ +1
$200K–$350K / yr
Posted Jul 22, 2026
Preference ModelSan Francisco
$200K–$350K / yr
Posted 4 days ago
Thinking Machines LabSan Francisco +1
$300K–$350K / yr
Posted Aug 31, 2026
Source: the Magic Ashby job board. We last checked this job 1 h ago. We first saw it 8 days ago. A job on a job board does not always mean that the team interviews people now. We found this job board in a public list. We did not yet compare it with the careers page of the company.
No one has reported an interview at Magic yet. Did you interview there? Add the questions.
This base pay is above the median for inference and ML systems jobs in the Bay Area with no level in the job title.
We compare the middle of each posted range. This is base pay as posted. The group does not include this job.