You will make Lyceum's AI inference platform reliable, secure, and scalable - ensuring it performs under pressure as we grow to thousands of concurrent users. While others on the team expand what the platform can do, your job is to make sure it keeps working, fails gracefully, and gets faster over time.
We consider candidates from diverse backgrounds, with a deep love for technical challenges and the desire to take on ownership beyond what's reasonably expected.
WHY US?
Scalability: Architect and implement the systems that allow our inference platform to scale to thousands of concurrent users. This includes request routing, load balancing, autoscaling, and resource scheduling across GPU clusters.
Reliability and observability: Build robust monitoring, alerting, and incident response tooling. Design for graceful degradation, automatic recovery, and minimal downtime.
Performance engineering: Profile and optimise the full inference path from request ingestion through model execution to response delivery. Identify and eliminate bottlenecks at every layer.
Infrastructure evolution: Evaluate and integrate open-source inference frameworks and tooling (Dynamo, vLLM, Triton, etc.) where they improve throughput, latency, or stability of the serving stack.
Pay not posted
Posted Apr 13, 2026
Pay not posted
Posted Aug 12, 2026
Dynamo AIBengaluru, India +1
Pay not posted
Posted Sep 28, 2026
VectaraUS Remote - Bay Area Preferred +3
Pay not posted
Posted Mar 25, 2026
Source: the Lyceum Ashby job board. We last checked this job 42 min ago. We first saw it 42 min ago. A job on a job board does not always mean that the team interviews people now. We found this job board in a public list. We did not yet compare it with the careers page of the company.
IncoBay Area HQ +1
$200K–$350K / yr
Posted Jul 22, 2026
inDriveLimassol, Cyprus
Pay not posted
No one has reported an interview at Lyceum yet. Did you interview there? Add the questions.