The role

We are looking for a Senior Data Platform Engineer to help drive the evolution of our Azure-based Data Platform and Lakehouse architecture.

This role is focused on the platform itself. The professional will own and evolve the foundations that data product teams build on: Apache Airflow orchestration (migrating from ADF), Azure resource management (Key Vault, identity and access, networking, storage), Azure DevOps CI/CD and Infrastructure as Code, Databricks and Unity Catalog governance, observability and cost efficiency, while remaining hands-on and close to the teams that use the platform.

Orchestration Platform (Apache Airflow & ADF)

Own the Apache Airflow platform: environments, deployment, upgrades, configuration, connections, variables, pools and DAG standards.
Work on the migration from Azure Data Factory to Airflow and the evolution of the Metadata-Driven Orchestration Framework (DAG generation, reusable operators, dependency and scheduling patterns).
Ensure Airflow is reliable and observable: SLAs, alerting, retries, backfills, health monitoring and clear failure ownership.

Azure Resource Management

Manage Azure resources with Infrastructure as Code (Terraform): Databricks workspaces, Data Lake Storage, Data Factory, Key Vault, networking and supporting services.
Own secrets and identity management: Key Vault, service principals and managed identities, secret scopes and rotation.
Own access management: Azure RBAC, Entra ID groups, Unity Catalog grants and ownership, following least privilege, plus access requests and periodic reviews.
Own Azure DevOps: repositories, CI/CD pipelines, branch policies and multi-environment promotion, including deployment validation and Terraform state.
Track cost and governance of Azure resources: tagging, budgets, right-sizing and cost attribution (e.g. query tagging).

Hands-on Data Platform evolution

Contribute to the implementation of the Data Catalog and Data Quality Framework and it’s lineage across the platform.
Drive observability: pipelines that are observable, debuggable and alert-driven, with clear ownership of failures.
Operate the Databricks platform: Unity Catalog structure, cluster and job policies, Auto Loader ingestion patterns, and performance and cost optimization of workloads.

Technical Leadership

Participate in architecture reviews and technical decision-making, stating trade-offs (performance, cost, reliability, complexity) with data.
Define and promote engineering standards: naming conventions, patterns and guidelines, through code reviews and design reviews.
Collaborate with Architects, Product Owners and data engineers in technical maturation of data products.
Build and maintain developer tooling and automation, including AI-assisted engineering workflows (shared agent instructions, skills, automated PR review).

Support & Operations (Run Team Collaboration)

Provide second-line support to the Run/Operations team for complex production topics.
Troubleshoot and resolve platform incidents, failures and performance issues; lead root cause analysis and post-mortems.
Ensure proper handover, documentation and operational readiness of platform changes.
Continuously improve runbooks, monitoring and operational processes.

Read the job posting on the MARGO site

Similar jobs at other companies

D
Senior Data Platform Engineer (Analytics & AI)
DistantJobRemote
- Senior
- Infra, platform & SRE
Pay not posted
Posted today
Senior Data Platform Engineer
ReplySeattle, Washington
- Senior
- Hybrid
- Infra, platform & SRE
$135K–$155K / yr
Posted Sep 2, 2026
Data Engineer
ReplyDetroit Area, Michigan +1
- Hybrid
- Data engineering
$130K–$150K / yr
Posted Aug 21, 2026
Data Engineer
ReplyAtlanta, Georgia +2
- Hybrid
- Data engineering
Pay not posted
Posted Aug 21, 2026
TD
Senior Data Engineer - Microsoft Data & AI
TTEC DigitalToronto, Ontario
- Senior
- Remote
- Data engineering
Pay not posted
Posted Oct 1, 2026
TD
Senior Data Engineer - Microsoft Data & AI
TTEC DigitalAustin, TX
- Senior
- Remote
- Data engineering
$155K–$175K / yr
Posted Oct 1, 2026

Source: the MARGO Lever job board. We last checked this job 3 h ago. We first saw it 2 days ago. A job on a job board does not always mean that the team interviews people now. We found this job board in a public list. We did not yet compare it with the careers page of the company.

Interview questions

No one has reported an interview at MARGO yet. Did you interview there? Add the questions.

MARGO

Open tech jobs: 49
With posted pay: 45%

About MARGO: funding, hiring and pay