Lead QA Automation Engineer drives end-to-end quality engineering for enterprise data products. This role will lead the design and implementation of scalable test automation frameworks, ensuring data quality, integrity, and reliability across complex data pipelines and platforms. The position will partner with product, engineering, and data teams to embed shift-left testing, establish automation standards, and deliver high-quality, production-ready data solutions.
Principle Duties- Lead small-to-medium QA initiatives with manageable risks, defining detailed test strategies, automation plans, and execution roadmaps
- Collaborate with business and IT stakeholders to translate data requirements into testable scenarios, ensuring data quality, validation, and completeness across the data lake
- Design, develop, and maintain test automation frameworks and quality engineering architecture aligned with big data platforms
- Perform data testing and validation, including data models, pipelines, transformations, and repository/catalog verification
- Build and support automated processes to validate data ingestion from source systems into the data lake, ensuring accuracy and reliability
- Provide team leadership, mentoring QA engineers, driving best practices, and owning overall quality outcomes for the team
- Develop test coverage models, data validation schematics, and capacity-aware testing strategies
- Drive continuous improvement in test automation efficiency, data validation performance, and security validation
- Establish and implement quality metrics, KPIs, and monitoring frameworks for data testing and automation effectiveness
- Recommend and enforce QA standards, automation frameworks, and testing processes across data platforms
Education- Bachelor's Degree in Arts/Sciences (BA/BS) or equivalent education/ experience - Required
- Master's degree in Arts/Sciences (MA/MS) - Preferred
Work Experience- 8+ years big data or relevant experience. Demonstrated ability to quickly learn new technologies - Required
- 8+ years experience with cataloging, modeling, ingestion, processing, and streaming technologies and processes - Required
- 4+ years of Data Analysis experience - Required
Skills and Abilities- Demonstrated ability to lead QA teams, drive automation strategy, and influence cross-functional stakeholders - Required
- Strong problem-solving and analytical skills with ability to validate complex data scenarios and communicate insights clearly - Required
- Expertise in data testing (ETL, data pipelines, data lake validation, reconciliation) - Required
- Proficiency in SQL and data validation techniques (data completeness, accuracy, lineage checks) - Required
- Strong understanding of CI/CD pipelines and automation integration - Required
- Experience validating data quality rules, transformations, and business logic across data layers - Required
- Knowledge of data security, privacy (PII), and compliance validation - Required
- Experience with API and integration testing (REST, JSON, data contracts) - Preferred
- Hands-on experience with test automation frameworks (Playwright, Selenium, Cypress) for UI + data validation - Preferred
- Experience working with big data platforms (Hive, Spark, NoSQL, data lake architectures) - Preferred
- Experience with data warehouse / BI testing (report validation, dashboards, metrics reconciliation) - Preferred
- Familiarity with cloud data platforms (Azure, AWS, Snowflake, Databricks) - Preferred
- Exposure to data observability, monitoring, and quality frameworks - Preferred
- Experience implementing test metrics, KPIs, and quality dashboards - Preferred
- Knowledge of performance testing for data pipelines - Preferred
#LI-CW1
#LI-remote
What you can expect from RGA:- Gain valuable knowledge from and experience with diverse, caring colleagues around the world.
- Enjoy a respectful, welcoming environment that fosters individuality and encourages pioneering thought.
- Join the bright and creative minds of RGA, and experience vast, endless career potential.
We're excited to get to know you and connect your unique skills with our global opportunities. To create a modern and seamless experience, we use artificial intelligence (AI) in parts of our preliminary screening process. This technology helps us personalize job recommendations, automate interview scheduling, evaluate candidates based solely on experience-without considering name, gender, or other personal details-and provide real-time answers through our chatbot. AI is used only during early screening and never makes hiring decisions. Your RGA recruiter will work closely with you every step of the way to ensure the process feels personal, thoughtful, and focused on you.
Compensation Range:$107,060.00 - $159,390.00 Annual
Base pay varies depending on job-related knowledge, skills, experience and market location. In addition, RGA provides an annual bonus plan that includes all roles and some positions are eligible for participation in our long-term equity incentive plan. RGA also maintains a full range of health, retirement, and other employee benefits.
