AWS Data Engineer who will design, build, and maintain robust data pipelines and connectors across AWS and Coveo. This role will have a strong focus on data quality, reliability, and validation, ensuring that data ingested into Coveo and downstream systems is accurate, complete, and production‑ready.
The engineer will work closely with search, data, and platform teams to support enterprise‑scale ingestion pipelines, improve data quality frameworks, and enable high‑quality search and content experiences.
Design, develop, and maintain scalable data pipelines on AWS (batch and near‑real‑time).
Own data quality validation across pipelines, including
Data completeness, freshness, consistency, and accuracy checks
Schema validation and anomaly detection
Implement automated data quality checks, alerts, and monitoring for pipeline failures or data issues.
Collaborate with search and platform teams to ensure high‑quality indexed data for Coveo sources.
Contribute to CI/CD pipelines and follow enterprise SDLC and security standards.
Produce clear documentation for pipelines, data contracts, and quality rules.
Perform in-depth analysis of search-indexed datasets to identify data quality issues to improve relevance, accuracy, and overall search performance.
Required Qualifications
Strong experience as a Data Engineer working on AWS.
Hands‑on experience building data pipelines using services such as:
AWS Glue,BedRock,Lambda, Step Functions, S3, SNS/SQS (or similar)
Proficiency in Python (and/or PySpark) for data engineering and validation logic.
Strong understanding of data quality concepts, frameworks, and best practices.
Experience integrating data from multiple sources (APIs, databases, files).
Solid knowledge of ETL/ELT patterns and data modeling fundamentals.
Experience with logging, monitoring, and alerting for data pipelines.
Familiarity with CI/CD practices and version control (Git).
Experience working with Coveo (sources, connectors, indexing, ingestion pipelines).
Prior experience supporting search platforms or content indexing pipelines.
Exposure to data quality frameworks or rule‑based validation approaches.
Knowledge of Snowflake.
Experience working in large enterprise or multi‑team environments.
Soft Skills
Strong problem‑solving and debugging skills.
Ability to work cross‑functionally with data, search, and platform teams.
Clear communication of data issues, risks, and remediation plans.
High ownership mindset with attention to detail, especially around data correctness.
November 15, 2026 – November 21, 2026
Not ready to apply? Join our Talent Community.
Caterpillar is an Equal Opportunity Employer. Qualified applicants of any age are encouraged to apply
CeteraDallas, TX
Pay not posted
Posted 26 days ago
VeriskGurugram, Haryana, India
Pay not posted
Posted today
CiklumUnited States
Pay not posted
Posted 12 days ago
$119K–$162K / yr
Posted Aug 19, 2026
EXLJersey City, New Jersey
Pay not posted
Posted 13 days ago
Jobs PlacemeGalway, IE
Pay not posted
Posted Sep 24, 2024
Source: the Cat Workday careers site. We last checked this job 4 h ago. We first saw it 4 h ago. A job on a job board does not always mean that the team interviews people now. We found this job board in a public list. We did not yet compare it with the careers page of the company.
No one has reported an interview at Cat yet. Did you interview there? Add the questions.