Senior Software Engineer, Apple Data Platform
Apple, Cupertino, California
The role
We are seeking extraordinary software engineers to work on Apache DataFusion Comet, the open-source accelerator for Apache Spark that Apple created and donated to the Apache Software Foundation. You are passionate about pushing distributed query engines to their limits and getting every ounce of performance out of them, while matching Spark’s results exactly. We are looking for engineers with in-depth knowledge of Spark internals and of related technologies such as Apache Iceberg, Parquet, Arrow, and DataFusion.
You are also excited about working in the open, collaborating with teams across Apple that run Spark at scale and contributing upstream to these open-source communities.