Platform Engineer - Self Hosting LLMs

You will build the LLM access layer for agents on the PhysicsX platform. That layer serves self-hosted open models and routes each task to the model, or combination of models, that best fits its constraints.

We want to bring deep, production experience in self-hosted LLM serving and model routing into PhysicsX. You will establish the capability to run open models reliably and choose between self-hosted and external models according to the needs of each workload. You will set the technical direction for inference engines such as vLLM and SGLang, and serving platforms such as KServe. You will build foundations that product, delivery and customer teams can rely on.