Senior Data Engineer (Databricks)
Solvd, Colombia +5
The role
We are seeking a highly skilled and consultative Senior Data Engineer with Databricks expertise to join our team.
What you will do
As a Data Engineer, you will provide technical leadership and guide customers to successful implementations of big data projects, ranging from architecture and design to data engineering to model deployment. You will lead clients through migrations and architect solutions from concept to production. You will provide structured mentorship for other team members and technical support for pre-sales efforts.
What you need
- Experience leading design and end-to-end development of distributed Databricks-based solutions, including Lakehouse architectures, ETL pipelines, streaming and batch processing, and integration with client's cloud and on-premises enterprise systems.
- Hands-on experience in building big data pipelines.
- Hands-on programming experience in Python.
- Expert knowledge of SQL, Spark (or PySpark), including data ingestion from a variety of sources such as APIs, relational databases, etc.