Key responsibilities ● Design, develop, and maintain large-scale data pipelines to support Ads reporting, attribution, and analytics use cases ● Work extensively with Hive, Spark, SQL, Scala, and Kafka to process and manage petabyte-scale datasets ● Optimize data workflows for performance, scalability, and cost efficiency ● Partner with data scientists, product managers, and platform engineers to deliver high-quality, reliable datasets and APIs ● Ensure data quality, integrity, and consistency across multiple data sources ● Troubleshoot and resolve issues in real-time streaming pipelines and batch data jobs ● Continuously evaluate new technologies to enhance the Ads Data platform
Skills and attributes for success: ● Strong programming experience in Scala (preferred), Java, or Python ● Hands-on experience with Apache Spark (batch & streaming) for large-scale data processing ● Proficiency in Hive, SQL, and data modeling for analytical workloads ● Experience working with Kafka for real-time event streaming ● Solid understanding of Big Data ecosystems (S4, Hive, Presto, Delta etc.) ● Strong debugging, performance tuning, and problem-solving skills ● Bachelor’s or master’s degree in computer science, Engineering, or related field. ● Experience in AdTech, Attribution, or Campaign Analytics ● Familiarity with cloud-based big data solutions (AWS EMR, GCP BigQuery, Databricks, etc.) ● Familiarity with scheduling services like AirFlow ● Knowledge of data governance, security, and compliance best practices Preferred education and experience: ● Bachelors/Masters in Computer Science or a related field with 4–6 years of experience in backend development