Staff Data Platform Engineer
CertifyOS, Bengaluru, India
The role
We're hiring a Staff Data Platform Engineer to own the data platform that makes CertifyOS the source of truth for provider data. You'll set the architecture, lead a team of engineers to deliver it, and be accountable for the reliability, freshness, and cost of our data.
What you will do
- Lead a team of engineers to deliver data platform initiatives end to end
- Own data architecture across OLTP, OLAP, and NoSQL stores (Aurora PostgreSQL, Redshift, MongoDB)
- Design and operate distributed real-time and batch pipelines in Python and PySpark (Kafka, Kinesis, SNS/SQS)
- Lead entity resolution and MDM architecture for provider data
- Build and own data products with clear contracts, SLAs, and consumers
- Be accountable for data reliability, freshness, quality, and cost, with the observability to prove it
- Drive performance and scale work: profile, benchmark, and re-architect as volume grows
- Build the data foundations for AI/ML workloads