ML Systems Engineer — Inference Acceleration
Arago, Paris Offices
What you will do
What you’ll do
Optimize the execution and serving of modern AI models on Arago's custom accelerator. Work across kernels, model execution, multi-device distribution, runtime, and inference serving, while helping shape the software stack around the capabilities of Arago's hardware.
Responsibilities
- Analyze modern AI workloads and identify kernel-, runtime-, memory-, and system-level bottlenecks on Arago's accelerator.
- Develop and optimize custom kernels, fused operators, and execution strategies to maximize device utilization.
- Design efficient mappings of models and operators across multiple Arago devices, including communication and synchronization strategies.