Job Title: Azure Data Engineer (Azure Data Factory & Azure Data Lake)
Overview / Summary
We are seeking an experienced Azure Data Engineer responsible for designing, developing, and maintaining scalable data integration and data storage solutions using Microsoft Azure services. The ideal candidate will have expertise in Azure Data Factory, Azure Data Lake Storage, ETL/ELT processes, data warehousing, and cloud-based analytics platforms.
Key Responsibilities
• Design, develop, and maintain data pipelines using Azure Data Factory.
• Build and manage enterprise-scale data lakes using Azure Data Lake Storage.
• Develop ETL/ELT workflows for ingesting data from multiple sources, including databases, APIs, flat files, and cloud applications.
• Implement data transformation processes using Mapping Data Flows, SQL, and Spark technologies.
• Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
• Configure incremental data loads, CDC (Change Data Capture), and data validation processes.
• Collaborate with data analysts, business stakeholders, and development teams to understand data requirements.
• Design data models and support data warehousing solutions.
• Implement security, governance, and access controls for cloud data platforms.
• Create technical documentation and maintain data architecture standards.
• Support migration of on-premises data solutions to Azure cloud environments.
Required Qualifications
• Experience designing, developing, and maintaining scalable data integration and data storage solutions using Microsoft Azure services.
• Expertise in Azure Data Factory.
• Expertise in Azure Data Lake Storage.
• Experience with ETL/ELT processes.
• Experience with data warehousing.
• Experience with cloud-based analytics platforms.
• Experience implementing data transformation processes using Mapping Data Flows, SQL, and Spark technologies.
• Experience configuring incremental data loads, CDC (Change Data Capture), and data validation processes.
• Experience designing data models and supporting data warehousing solutions.
• Knowledge of security, governance, and access controls for cloud data platforms.
• Experience supporting migration of on-premises data solutions to Azure cloud environments.
#LI-Remote #LI-PS4 #Hiring
