Full Job Description
ETL Automation Quality Engineer
Role Overview
We are seeking a detail-oriented ETL Automation Quality Engineer to ensure the reliability, accuracy, and efficiency of data pipelines. This role combines expertise in ETL processes, automation, and quality engineering to validate data integrity and system performance in a cloud-based environment.
Key Responsibilities
Design, develop, and maintain automated test frameworks for ETL workflows
Validate data accuracy, consistency, and integrity across databases and data lakes
Write complex SQL queries to test data transformations and quality
Develop Python-based automation scripts for testing, monitoring, and reporting
Integrate automated testing into CI/CD pipelines using GitHub and GitHub Actions
Manage and validate data processing workflows in AWS environments, including AWS S3
Apply quality engineering methodologies, including test planning, risk analysis, and defect tracking
Develop and execute test cases for ETL processes and end-to-end data workflows
Validate API integrations and data exchanges where applicable
Document test strategies, test results, and improvement recommendations
Collaborate with cross-functional teams to troubleshoot data issues and optimize ETL processes
Must-Have Skills
Strong SQL expertise with hands-on data validation and complex query development
Proficiency in Python scripting and test automation
Experience with ETL testing and automation frameworks
Hands-on experience with Unix/Linux environments
Experience working with AWS cloud services, including AWS S3
Knowledge of Hadoop, Parquet, and large-scale data platforms
Experience using GitHub and GitHub Actions for source control and CI /CD
Strong understanding of Quality Engineering principles and testing methodologies
Experience in defect tracking, root cause analysis, and test planning
Strong analytical and problem-solving skills
Excellent communication and stakeholder management skills
Nice-to-Have Skills
Experience with API testing and validation
Exposure to data lakes and modern data engineering architectures
Knowledge of CI/CD best practices for data platforms
Experience with performance and scalability testing of ETL pipelines
Familiarity with Agile/Scrum development methodologies
Experience working in Banking, Financial Services, or other regulated environments
Salary Range - CA$ 90,000 - CA$ 110,000 Per Year
TCS does not use artificial intelligence tools for candidate screening or evaluation. This post is for a current vacancy. The hiring process includes an initial screening, followed by a technical evaluation and managerial discussion.