(Senior) Software Engineer - Data Core
Celonis, Munich, Germany
The team
Data Core is the storage abstraction layer behind Celonis' data pipelines. It sits between ETL workloads and the backends that run them, such as Databricks, Snowflake, StarRocks, Spark, and PostgreSQL. You will work mainly on three codebases:
- Data Core, a Java / Spring Boot service with gRPC and message-queue APIs.
- sqlglot, where we translate and optimize SQL across dialects.
- StarRocks, the OLAP engine we use as a backend.
What you will do
- Implement features and fix bugs in Data Core backend integrations.
- Add and fix sqlglot dialect support: parsing, SQL generation, and transpilation correctness.
- Investigate StarRocks behavior and compatibility issues, and contribute fixes or workarounds.
- Debug slow or incorrect queries by following them from SQL text to query plan to results.
- Write unit and integration tests, especially for SQL translation edge cases.
- Take part in design discussions, write short design docs for your own work, and give and receive code reviews.