Cloud Inference Engineer

Founding, on site in downtown SF. Ship low latency, high throughput model serving on Luminal Cloud.

• Deploy and tune models with optimizations like KV caching, paged attention, sequence packing, etc.
• Conducting model performance reviews
• Improve scheduler, batcher, autoscaling; profile latency, cost, utilization
• Sometimes write kernels and, yes, occasional tasteful shitposting

• CUDA + GPU inference optimization
• vLLM, SGLang, or TensorRT-LLM experience
• KV caching, paged attention, batching, token streaming, etc.
• Distributed compute (with GPUs is a super plus)
• No degree required

Luminal (YC S25) builds an AI compiler and serving stack that makes models 10x faster and production ready with one line.

San Francisco, CA, US · Full-time · On-site. Annual base salary: $150,000–$250,000 USD. Equity: 0.15%–0.75%. Visa: US citizen/visa only.