Tata Consultancy Services

ETL Automation Quality Engineer

Tata Consultancy Services$90K — $110K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Strong SQL expertise with experience in complex query development and data validation.
  • Proficiency in Python for scripting and automation tasks.
  • Hands-on experience with ETL testing and automation frameworks.
  • Familiarity with Unix/Linux operating systems.
  • Experience with AWS services, particularly AWS S3.
  • Knowledge of Hadoop and large-scale data platforms.
  • Strong understanding of Quality Engineering principles and testing methodologies.

Responsibilities

  • Design and maintain automated test frameworks for ETL workflows.
  • Validate data integrity and accuracy across different databases.
  • Write and execute complex SQL queries for data testing.
  • Develop Python scripts for automation in testing and monitoring.
  • Integrate automated tests into CI/CD pipelines with GitHub.
  • Manage data processing workflows within AWS environments.
  • Collaborate with teams to troubleshoot and optimize ETL processes.

Benefits

  • Collaborative work environment with cross-functional teams.
  • Opportunity for skill development in cloud technologies and automation.
  • Flexible work arrangements that promote work-life balance.
  • Exposure to cutting-edge data engineering practices and frameworks.
  • Learning opportunities in quality engineering and data integrity best practices.
Full Job Description
ETL Automation Quality Engineer Role Overview We are seeking a detail-oriented ETL Automation Quality Engineer to ensure the reliability, accuracy, and efficiency of data pipelines. This role combines expertise in ETL processes, automation, and quality engineering to validate data integrity and system performance in a cloud-based environment. Key Responsibilities Design, develop, and maintain automated test frameworks for ETL workflows Validate data accuracy, consistency, and integrity across databases and data lakes Write complex SQL queries to test data transformations and quality Develop Python-based automation scripts for testing, monitoring, and reporting Integrate automated testing into CI/CD pipelines using GitHub and GitHub Actions Manage and validate data processing workflows in AWS environments, including AWS S3 Apply quality engineering methodologies, including test planning, risk analysis, and defect tracking Develop and execute test cases for ETL processes and end-to-end data workflows Validate API integrations and data exchanges where applicable Document test strategies, test results, and improvement recommendations Collaborate with cross-functional teams to troubleshoot data issues and optimize ETL processes Must-Have Skills Strong SQL expertise with hands-on data validation and complex query development Proficiency in Python scripting and test automation Experience with ETL testing and automation frameworks Hands-on experience with Unix/Linux environments Experience working with AWS cloud services, including AWS S3 Knowledge of Hadoop, Parquet, and large-scale data platforms Experience using GitHub and GitHub Actions for source control and CI /CD Strong understanding of Quality Engineering principles and testing methodologies Experience in defect tracking, root cause analysis, and test planning Strong analytical and problem-solving skills Excellent communication and stakeholder management skills Nice-to-Have Skills Experience with API testing and validation Exposure to data lakes and modern data engineering architectures Knowledge of CI/CD best practices for data platforms Experience with performance and scalability testing of ETL pipelines Familiarity with Agile/Scrum development methodologies Experience working in Banking, Financial Services, or other regulated environments Salary Range - CA$ 90,000 - CA$ 110,000 Per Year TCS does not use artificial intelligence tools for candidate screening or evaluation. This post is for a current vacancy. The hiring process includes an initial screening, followed by a technical evaluation and managerial discussion.

About Tata Consultancy Services

Tata Consultancy Services (TCS) is an Indian multinational information technology (IT) services and consulting company, headquartered in Mumbai, Maharashtra, India. It is a subsidiary of Tata Group and operates in 149 locations across 46 countries. TCS is the largest Indian company by market capitalization and is ranked 11th on the Forbes Global 2000 list of the world's biggest public companies. TCS is also the second-largest IT services company in the world by revenue and the largest employer of women in India. The company provides services in areas including IT, consulting, and business solutions.
Learn more about Tata Consultancy Services
Size
469,261 employees
Industry

Similar Jobs

More Jobs at Tata Consultancy Services

More Information Technology Jobs

Find similar ETL Automation Quality Engineer jobs: