Inference Engineer – LLM & Speech AI
Soket AI, Bengaluru, India
Overview
We are looking for an experienced Inference Engineer to build and optimize high-performance inference systems for Large Language Models (LLMs), Speech AI systems, and multimodal AI workloads. You will work on deploying production-grade AI systems with a strong focus on: low latency, high throughput, GPU efficiency, scalable serving infrastructure, distributed inference, and cost optimization. This role sits at the intersection of: systems engineering, deep learning infrastructure, distributed computing, and production AI deployment.
You will collaborate closely with: ML researchers, platform engineers, speech AI teams, and product engineering teams.
Similar jobs at other companies
LLM Inference Engineer (Mid, Sr, Staff)
Hippocratic AIMenlo Park, CA
Pay not posted
Posted Sep 30, 2026
LLM Inference Systems Engineer
Hippocratic AIMenlo Park, CA
Pay not posted
Posted Oct 7, 2026
LLM Inference Engineer
Near AISan Francisco or Remote +1