Job Summary

We are seeking a Data Quality Engineer to design and execute test strategies for data projects on Databricks, AWS, and Delta Sharing platforms. The role involves validating ingestion pipelines, transformations, and Medallion Architecture layers, ensuring secure data access with Unity Catalog and RBAC. Candidates will build automated testing frameworks, collaborate with cross-functional teams, and support release planning while driving data governance and quality initiatives across the Databricks ecosystem.

Mandatory skills:

1. Databricks
2. AWS
3. Delta Sharing
Key Responsibilities
• Develop and execute test plans, test cases, and validation strategies for data projects built on Databricks, AWS, and Delta Sharing platforms.
• Validate data ingestion pipelines, data transformations, and Medallion Architecture layers to ensure data quality, accuracy, completeness, and performance.
• Create and maintain automated data testing frameworks using SQL and automation tools to support repeatable regression testing.
• Test and verify Delta Sharing, Unity Catalog, role-based access controls, and data security mechanisms to ensure secure data access and governance.
• Collaborate with Development, Product Owners, and Data Engineering teams to identify defects, track quality metrics, and resolve testing issues.
• Support release planning, deployment validation, and production deployments while providing clear communication on testing status, risks, and issues.
• Contribute to data governance and quality initiatives, including data catalog migration, DQ framework adoption, and testing best practices across the Databricks ecosystem.