Data Engineer
ABACUS, Remote in US
The role
Overview
The Data Engineer is responsible for developing, maintaining, and supporting data pipelines using Python and SQL Server (T-SQL), while assisting with data integration from internal and external systems within a modern Azure-based data platform. The role supports critical data operations in regulated environments and provides opportunities for hands-on learning and growth under the guidance of senior data engineers.
Job Description
- Develop and maintain ETL pipelines using Python and SQL Server for data ingestion, transformation, and integration from various data sources, including structured files and RESTful APIs.
- Write, test, and debug Python code for data processing, automation, and basic integrations following established standards and best practices.
- Create and maintain T-SQL queries, views, and stored procedures to support business logic and reporting requirements.
- Assist in building and operating data workflows using Azure Data Factory, Azure SQL, and Azure Blob Storage.
- Support the monitoring of data pipelines and help troubleshoot data quality issues, pipeline failures, and performance problems.
- Follow defined data quality, security, and compliance procedures in regulated environments such as healthcare and financial services.