Senior Data Platform Engineer / Engenheiro de Plataforma de Dados Senior
Fugro, Remote
The role
Job Description
What you will do
- Design, deploy, and maintain secure, highly available Kafka clusters in AWS (MSK or self-managed).
- Perform capacity planning, performance tuning, and proactive scaling.
- Automate infrastructure and configuration using Terraform and GitOps principles.
- Manage and optimize Databricks workspaces, clusters, jobs, and streaming pipelines on AWS.
- Implement observability: metrics, Grafana dashboards, CloudWatch alarms.
- Develop runbooks for incident response, disaster recovery, and rolling upgrades.
- Ensure compliance with security and audit requirements (ISO27001).
- Collaborate with development teams to provide Kafka best practices for .NET microservices and Databricks streaming jobs.
- Conduct resilience testing and maintain documented RPO/RTO strategies.
- Drive continuous improvement in cost optimization, reliability, and operational maturity.
What you need
- 5+ years of experience in data platform, cloud platform, SRE, DevOps, or infrastructure engineering roles, including at least 3 years of hands-on experience operating Kafka in production environments.
- Strong knowledge of Kafka internals: partitions, replication, ISR, controller quorum, KRaft.
- Expertise in AWS services: VPC, EC2, MSK, IAM, Secrets Manager, networking.
- Familiarity with Databricks Structured Streaming and Kafka Connect
- Proven experience with TLS/mTLS, SASL/SCRAM, ACLs, and secure cluster design. Proficiency in Infrastructure as Code (Terraform preferred).
- Familiarity with CI/CD pipelines for cluster and topic configuration.
- Monitoring and alerting using Grafana, CloudWatch, and log aggregation.
- Disaster recovery strategies.
- Strong scripting skills (Bash, Python) for automation and tooling.
- Excellent documentation and communication skills.
- At least Upper-Intermediate level of spoken and written English.
Nice to have
- Cloud Certifications, preferably AWS
- Knowledge of Schema Registry (Protobuf) and schema governance.
- Previous experience working with geospatial data.
Senior Data Platform Engineer (Kafka & Databricks)
We are building the Common Data Backbone (CDB) - Fugro’s strategic data platform, which enables discovery, governance, and integration across our global geospatial data ecosystem. The CDB connects multiple cloud services and end-user applications through Apache Kafka, serving as the integration solution within the CDB for event orchestration and integration services.