Full Job Description
Lead Data Integration Engineer with Azure Data Factory and Databricks
We are seeking a Lead Data Integration Engineer to design, build, and maintain scalable data integration pipelines across cloud and enterprise systems. The role focuses on data ingestion, transformation, orchestration, and automation using Azure Data Factory, Databricks, and the broader Azure data ecosystem.
Responsibilities
Design and develop ETL/ELT pipelines using Azure Data Factory
Integrate data from databases, APIs, files, SaaS platforms, and cloud storage
Build and manage data workflows, triggers, linked services, datasets, and pipelines
Implement data validation, monitoring, error handling, and performance optimization
Leverage Azure Data Lake, Azure SQL, Synapse, and Databricks as needed
Partner with data engineers, analysts, and business teams to deliver reliable data solutions
Support deployment, CI/CD, security, and access controls for data pipelines
Requirements
5+ years of hands-on experience with Azure Data Factory
Proficiency in SQL and data integration concepts
Experience with Azure data services such as ADLS, Azure SQL, and Synapse
Background in Databricks for data processing and transformation
Proficiency in English at a B2+ level