Data Engineer
Capco, India - Bengaluru
What you need
- Design, develop, and maintain data pipelines and workflows using AWS EventBridge, Step and Lambda Functions, and Secrets Manager.
- Utilize Python as the primary programming language to develop and maintain data applications.
- Implement and manage REST API calls to integrate various data sources and services.
- Collaborate with stakeholders to understand data requirements and deliver solutions.
- Optimize data workflows for performance, scalability, and reliability.
- Ensure data security and compliance by managing secrets and sensitive information using AWS Secrets Manager.
- Monitor and troubleshoot data pipelines to ensure smooth operation and timely data delivery."
- "Proven experience as a Data/Integration Engineer or in a similar role.
- Strong knowledge of AWS services, particularly EventBridge, Step Functions, S3, AWS Lambda and Secrets Manager.
- Proficiency in Python and experience with REST APIs
- Expertise in writing and optimizing SQL queries to detecting changes in source data
- Experience with data modeling and transformation to meet required web service contracts.