Software Engineer Data Platform

We're looking for an experienced Software Engineer to join our Data Platform Group. In this key role, you will build the company’s data platform: cloud-based microservices and data pipelines that process approximately 1M records per second at low latency. Because the platform is the foundation other groups build on, your work directly impacts our customers and enables engineering, product, and research teams across the organization. The Streaming team owns the real-time heart of the platform: every record enters the company through our pipelines, and we process it in motion.

We build high-throughput Go services and Kafka-based pipelines that ingest, enrich, aggregate, and route our data in real time, at low latency. We also build external integrations that deliver our data to customers, partnering closely with Product to define and implement connectors that meet customer needs. At this scale, efficiency is the product. We care about how many records per second each core handles and how many bytes each record costs in memory.

If you enjoy profiling hot paths, pushing CPU utilization to the limit, and cutting memory footprint without giving up correctness, this is the role.