Senior Staff Software Engineer, Serving
Liftoff, United States (remote)
What you will do
- Design, build, and operate the high-throughput, low-latency services that receive bid requests, execute Liftoff’s bidding logic, and respond to ad exchanges in real time.
- Improve the performance, scalability, and reliability of systems that process millions of requests per second under strict latency constraints.
- Develop and optimize GPU-powered inference services that execute neural network models using TensorRT.
- Profile end-to-end inference pipelines to identify and eliminate bottlenecks in GPU utilization, batching, memory access, serialization, networking, and request handling.
- Partner with machine learning engineers to productionize new model architectures and features, translating modeling requirements into efficient and reliable serving implementations.