Position Overview:
*This position is contingent upon contract award*
The Testing Manager is responsible for automated testing, performance testing, and security testing across the CMS Drug Data Processing System (DDPS) and Payment Reconciliation System (PRS). This individual owns the end-to-end quality assurance strategy, including the 80 percent automated unit test coverage mandate, Behavior-Driven Development (BDD) and Test-Driven Development (TDD) practices, QASP metric definition and self-assessment, and test tooling operations within the CMS enterprise test environment.
This is a remote position; however, Cognitive hires only in the following designated U.S. states based on contract and business requirements: VA, DC, MD, TN, FL, AZ, CO, OR, and TX.
Key Responsibilities:
- Own automated, performance, and security testing across the DDPS/PRS estate; maintain 80 percent or greater automated unit test coverage using Python Pytest/UnitTest and DBFit/FitNesse frameworks; support BDD and TDD practices across all sprint teams.
- Perform regression and post-implementation validation testing following each CMS release; integrate automated test execution into the CI/CD pipeline via Jenkins/CloudBees, JFrog Artifactory, SonarQube, and Snyk.
- Operate within CMS enterprise test tooling including TestRail for test case management, JIRA for defect tracking, and GitHub for source-controlled test artifacts.
- Propose and maintain QASP performance standards, metrics, measurement methods, reporting frequencies, and corrective action thresholds for both technical/system and operational/process metrics; submit quarterly QASP self-assessments no later than 2 weeks after PI end.
- Track and surface real-time operational quality metrics like PDE processing volumes, error rates, reconciliation accuracy, and system uptime using CloudWatch, Splunk, and New Relic.
- Support security testing coordination with Nessus, CrowdStrike, AWS Inspector, SecurityHub, and GuardDuty; comply with CMS AI governance policies when testing AI/ML models including bias detection and human-in-the-loop review.
- Operate within the CMS Lean-Agile Release Train adhering to the MEPS Iteration Schedule; contribute to PI Planning and submit Release Deliverables per the MEPS Agile Handbook.
Qualifications:
- Bachelor's degree in Computer Scienceor related field; 8 or more years in software QA including test automation leadership on production systems.
- Hands-on expertise with Python test frameworks, Pytest and UnitTest.
- Experience with database testing using DBFit and FitNesse frameworks.
- Experience with test management tools including TestRail, JIRA, and GitHub.
- Experience designing and enforcing automated test coverage gates at 80 percent or greater within CI/CD pipelines.
- Experience with CI/CD-integrated testing using Jenkins/CloudBees, JFrog Artifactory/XRay, SonarQube, and Snyk.
- Experience designing performance test approaches for high-volume data processing systems.
- Experience developing and maintaining QASP performance standards and submitting quarterly self-assessments on federal contracts.
- Experience with monitoring and observability tools including AWS CloudWatch, Splunk, and New Relic for real-time quality metric tracking.
- Familiarity with federal security compliance testing requirements under FISMA, NIST, and CMS ARS.
- Ability to pass CMS and internal required background checks for public trust.
