Skills:
Strong expertise in Azure Databricks (Workflows, Delta Lake, Delta Live Tables, Unity Catalog).
Hands-on experience with Azure Data Factory (pipelines, monitoring, CI/CD).
Proficiency in Python, PySpark, SQL for test automation.
Knowledge of data governance, PII compliance, and data quality frameworks.
Experience in CI/CD pipelines, DevOps practices, and cloud data platforms.
Strong communication and leadership abilities for cross-functional teamwork.
Key Responsibilities
Data Testing & Validation
Design and implement test plans, test cases, and test automation for data pipelines (ELT/ETL).
Validate payer data, including claims, membership, provider, and clinical datasets.
Conduct FHIR-based API testing for CMS Interoperability compliance.
Validate HEDIS measure calculations and quality reporting data.
CI/CD Integration
Develop Azure DevOps test plans with QA gates for Databricks Jobs/DLT and ADF
deployments.
Technical Delivery
Collaborate with product owners, Azure Data Factory (ADF), Databricks engineering teams to
ensure end-to-end data quality.
Build and maintain data quality automation frameworks leveraging PySpark, SQL, and Python.
Work with data governance and business teams to resolve data quality issues.
Performance & Scalability
Design automated load and stress tests for large-scale data pipelines.
Compliance & Best Practices
Ensure data QA practices adhere to HIPAA, CMS, and payer industry standards.
Document QA processes, test results, and provide audit-ready evidence.
Able to mentor / guide the Junior QA resources.
