Senior Data Engineer
BEES, Campinas, São Paulo, Brazil +1
BEES has this job in 1 other place
What you will do
- Own the technical design and delivery of the data model for a BEES business domain. Start from business intent and from the data sources that exist, and produce authoritative definitions for entities, assets, attributes, relationships, identifiers, and grain.
- Profile source systems and Unity Catalog tables (grain, keys, cardinality, overlap, nulls, and how columns are derived) and decide which sources can support a trustworthy representation of the business.
- Produce and evolve the domain's canonical logical model and canonical datasets, including identifiers, relationships, and cardinalities. Map attributes to physical columns, with transformation, nullability, and lineage documented so consumers can trust the result.
- Design master-data outcomes for the domain, including entity resolution: match approach, blocking keys, duplicate handling, cross-system identity, and survivorship when sources disagree.
- Define advanced data-quality expectations on the model (uniqueness at the declared grain, referential integrity, completeness, validity, consistency across sources, reconciliation, and freshness) and contribute to the Data Quality Framework and Tooling so those expectations become executable checks and monitoring.