Job DescriptionAbout the JobJob SummaryWe are looking for an experienced
Senior Azure Databricks & Microsoft Fabric Data Engineer to design, develop, and implement scalable cloud-based data platforms using Microsoft Azure technologies. The ideal candidate should have strong hands-on experience with
Azure Databricks, Microsoft Fabric, and modern data engineering practices, along with the ability to deliver enterprise-scale data platform solutions from design through production deployment.
Key Responsibilities- Design, develop, and maintain scalable data pipelines using Azure Databricks.
- Develop ETL/ELT workflows using PySpark, Spark SQL, Delta Lake, and Databricks Notebooks.
- Build and optimize Lakehouse and Data Warehouse architectures.
- Develop and manage Microsoft Fabric Lakehouses, Dataflows Gen2, Data Pipelines, and OneLake solutions.
- Perform data ingestion, transformation, validation, and performance tuning.
- Collaborate with business stakeholders, solution architects, BI developers, and cross-functional teams to translate business requirements into technical solutions.
- Participate in solution design, code reviews, testing, deployment, and production support.
- Follow best practices for data security, governance, documentation, and CI/CD.
Mandatory Skills- Strong hands-on experience with Azure Databricks.
- Expertise in PySpark, Spark SQL, Delta Lake, and Databricks Notebooks.
- Solid working knowledge of Microsoft Fabric, including Lakehouses, Dataflows Gen2, Data Pipelines, and OneLake.
- Strong understanding of Data Warehouse and Lakehouse architecture.
- Experience delivering large-scale enterprise data platform projects from design to production.
- Strong SQL skills and data modelling experience.
- Excellent communication and stakeholder management skills.
Good to Have- Power BI (Data Modelling, DAX, Power Query, Report Development).
- Azure Data Factory, Azure Data Lake Storage Gen2, Azure DevOps, Git, CI/CD.
- Azure Synapse Analytics, Unity Catalog, Microsoft Purview.
- Experience in Agile/Scrum environments.
- Microsoft Azure or Microsoft Fabric certifications.
Required Experience- 8-15 years of overall IT experience with at least 4+ years in Azure Data Engineering.
- Proven experience building enterprise-scale cloud data platforms.
- Experience working with structured and semi-structured data.
- Strong problem-solving and analytical skills with the ability to work independently.
EducationBachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related discipline.
Preferred Domain ExperienceExperience in
Manufacturing, Pharmaceuticals, Healthcare, Life Sciences, or Supply Chain domains will be an advantage. Exposure to regulated environments (GxP/FDA) is desirable.
Keywords: Azure Databricks, PySpark, Delta Lake, Microsoft Fabric, Lakehouse, OneLake, Dataflows Gen2, Data Pipelines, SQL, Data Warehouse, Azure Data Engineering, Power BI, DAX, Azure DevOps, ETL, Cloud Data Platform.
Must be ready to work from office 5 days a week.The customer site office is based in Lebanon, Indianapolis. 
