Inference Software Engineer
Etched, San Jose
What you will do
- Support porting state-of-the-art models to our architecture. Help build programming abstractions and testing capabilities to rapidly iterate on model porting.
- Build, enhance, and scale our runtime, including multi-node inference, intra-node execution, state management, and robust error handling.
- Optimize routing and communication layers using our collectives.
- Utilize performance profiling and debugging tools to identify bottlenecks and correctness issues.
What you need
- Proficiency in C++ or Rust.
- Understanding of performance-sensitive or complex distributed software systems like Linux internals, accelerator architectures (e.g. GPUs, TPUs), Compilers, or high-speed interconnects (e.g. NVLink, InfiniBand).
- Familiarity with PyTorch or JAX.
- Ported applications to non-standard accelerator hardware or hardware platforms.