Research Engineer - Geo-Distributed Inference
Pluralis Research, San Francisco +1
What you will do
- Own the inference stack: You build and own it end-to-end. Pipeline-parallel execution, placement and routing, the transport, the serving engine, and failure handling. You set the direction, and you make things happen.
- Invent the algorithms: Making inference fast on consumer hardware over the public internet takes methods that don't exist yet. You design them, validate them, and put them in production.
- Serve training and users: You keep the rollout pipeline fast and reliable for RL training now, and turn it into the serving layer for our models once they're trained.