Applied ML Engineer - Edge Devices

Deepgram's speech models are among the fastest and most accurate in the world, and today we run them at scale on NVIDIA GPUs. Our customers increasingly need those same models on hardware we don't control: non-NVIDIA accelerators, edge servers, and embedded platforms with their own inference runtimes, operator sets, and constraints. Getting Deepgram models onto those platforms, with as few changes to the model as possible and no changes to the hardware paradigm, is the job.

As an Applied ML Engineer on the Partner Platform Engineering team, you sit one layer above the metal. You take a Deepgram model as it exists today and adapt it to run correctly and efficiently within a target platform's existing kernel and runtime paradigm: swapping or reshaping operators, adjusting architecture parameters, choosing quantization and precision schemes, and validating accuracy and latency on the real device. Where a standard kernel isn't enough, you work with our Embedded AI Engineers, who write the custom kernels, and fit the model to what they build.