This position is responsible for designing, building, and maintaining the automated testing frameworks, QA infrastructure, and quality processes that validate software health from commit to production. This role will work closely with software engineers, DevOps engineers, product owners, and business stakeholders to embed automated validation throughout the software development lifecycle (SDLC), ensuring that rapid delivery does not come at the cost of stability or quality. This role will also aid in the evolution of the test automation stack and the adoption of AI-assisted testing practices built on large language models (LLMs) and AI orchestration tooling.
The ideal candidate combines a quality engineering mindset with a strong DevOps foundation, including CI/CD pipelines, infrastructure as code, bare-metal and on-premises infrastructure, and source control systems such as Git.
This role has a flexible work arrangement, meaning we are open to employees working
remotely or in-office. Periodic travel to the Atlanta, IN office is expected.
Responsibilities
- Design, develop, and maintain automated test suites (UI, API, integration, and regression) in TestCafe, and aid in the ongoing evolution of the test automation framework and tooling.
- Build and maintain QA infrastructure and tooling - test environments, test data management, and test runners - using infrastructure-as-code and containerization practices.
- Integrate automated testing into CI/CD pipelines as quality gates, in collaboration with DevOps and development teams, to improve release speed, quality, and reliability.
- Apply test automation best practices, including the testing pyramid, maintainable test architecture, flaky-test management, and actionable reporting.
- Evaluate and adopt AI-assisted testing capabilities - LLMs and AI orchestration tooling (e.g., Hermes, Autonoma, in-house solutions) - for test generation, failure triage, and expanded coverage.
- Champion quality across the full SDLC, participating in requirements reviews, design discussions, and release readiness decisions to shift testing left.
- Monitor test and pipeline health, troubleshoot failures, and implement improvements for stability and scalability.
- Track and report quality metrics such as test coverage, defect trends, and escaped defects to inform release decisions.
- Perform exploratory, performance, and security-focused testing where automated coverage is insufficient.
- Mentor engineers on test automation practices and maintain documentation for frameworks, processes, and operational procedures.
Job Requirements
Education:
- BS in computer science, engineering, or a related field plus 10+ years' experience in software quality assurance, test automation, software development, or DevOps engineering
Technologies:
- Deep understanding of the SDLC and QA methodologies, including test planning, risk-based testing, the testing pyramid, and defect lifecycle management.
- Experience building UI and API test automation with frameworks such as TestCafe, Playwright, Cypress, or Selenium; ability to lead the adoption of Autonoma or similar orchestration tooling.
- Proficiency in JavaScript/TypeScript and one or more scripting languages such as Python, Bash, or PowerShell.
- Experience with CI/CD tools such as Jenkins, GitHub Actions, or Azure DevOps, including integrating automated test stages and quality gates.
- Working knowledge of DevOps and infrastructure-as-code tooling such as Terraform, Ansible, and Docker for maintaining QA environments and tooling.
- Familiarity with AI tech stacks, LLMs, and AI orchestration tooling such as Hermes or OpenClaw, and their application to testing workflows.
- Experience with source control systems such as Git.
- Strong troubleshooting, problem-solving, and communication skills; ability to work collaboratively across technical and non-technical teams.
Experience:
- Ten (10)+ years' experience in software quality assurance and test automation, including hands-on experience supporting CI/CD pipelines, DevOps tooling, or QA infrastructure. Familiarity with infrastructure, product, design, and development workflows.
