Data Engineer
AnaVation, Huntsville, AL
What you will do
- Design, build, and optimize scalable ETL/ELT pipelines for ingestion, transformation, and migration of large, multi-source datasets.
- Develop data models, schemas, mappings, and integration structures supporting legacy-to-cloud migration.
- Improve pipeline automation, performance, throughput, reliability, and fault tolerance.
- Lead data cleansing, normalization, enrichment, validation, and root-cause analysis for data quality issues.
- Partner with QA, Cloud, DevSecOps, Migration, and development teams to integrate and validate data workflows.
- Support AWS-based data engineering and ensure compliance with security, logging, auditing, and data-handling requirements.
- Mentor data engineers and participate in technical reviews, sprint activities, architecture discussions, and migration planning.
- Maintain pipeline diagrams, mapping specifications, data dictionaries, and other technical documentation.
- Track migration progress, pipeline performance, data quality, risks, and blockers, and support timely resolution.