Inference Intern
Etched, San Jose
What you will do
- Support porting state-of-the-art models to our architecture. Help build programming abstractions and testing capabilities to rapidly iterate on model porting.
- Assist in building, enhancing, and scaling our runtime, including multi-node inference, intra-node execution, state management, and robust error handling.
- Contribute to optimizing routing and communication layers using our collectives.
- Utilize performance profiling and debugging tools to identify bottlenecks and correctness issues.
- Develop and leverage a deep understanding of our architecture to co-design both HW instructions and model architecture operations to maximize model performance