AIML - Staff ML Infrastructure Engineer, ML Platform & Technology - Pre-training Infrastructure
Apple, California
The role
As an engineer on the ML Compute team, your work will include: * Drive performance optimization for large-scale foundation model training on TPUs, focusing on efficiency, throughput, and scalability * Profile and optimize JAX/XLA workloads across compute, memory, communication, and compilation. * Develop and optimize high-performance TPU kernels for critical ML operations such as attention and Mixture-of-Experts (MoE) * Optimize distributed training techniques, sharding strategies, and collective communication over TPU interconnects (ICI/Fabric) * Research and implement new techniques across the JAX, XLA, and TPU stack to improve end-to-end training performance * Develop performance profiling, benchmarking, and automated tuning capabilities for large-scale training workloads. * Collaborate with cross-functional engineers to solve large-scale ML training challenges * Lead complex technical projects and mentor engineers in areas of your expertise * Cultivate a team centered on collaboration, technical excellence, and innovation