Job DescriptionThe selected candidate will be responsible for evaluating and validating the complete user experience, ensuring accessibility compliance, functional accuracy, usability, and adherence to legal, privacy, and content governance requirements. This role requires expertise in accessibility testing, software quality assurance, AI-enabled applications, and Section 508 compliance.
The Accessibility Specialist will work closely with business analysts, developers, solution architects, and quality assurance personnel to ensure the application delivers accurate, accessible, secure, and trustworthy information to the public.
Responsibilities include, but are not limited to:• Accessibility Testing
• Perform Section 508/WCAG accessibility testing using DHS Trusted Tester processes.
• Conduct manual and automated accessibility assessments.
• Validate assistive technology compatibility and identify remediation needs.
• AI & Conversational Validation
• Test AI responses, semantic search, citations, and content summaries.
• Validate user intent recognition and conversational accuracy.
• Ensure responses remain grounded in approved source content.
• Functional Testing
• Develop and execute test plans and test cases.
• Perform functional, regression, system, and end-to-end testing.
• Validate cross-browser, cross-device, and user feedback functionality.
• Responsible AI & Governance Testing
• Validate content safety controls, business rules, and compliance requirements.
• Verify privacy controls, PII filtering, and content moderation.
• Ensure AI outputs comply with governance and approved-content requirements.
• Reporting & Documentation
• Document defects, test results, and compliance findings.
• Produce testing reports and recommendations.
- Support reviews and continuous improvement efforts
Required Skills• Must have
Bachelor of Science degree in Computer Science, Information Systems, Engineering, Business, or other relevant discipline.
• Minimum 3 years of experience performing functional testing of software applications using both manual and automated testing tools.
• Minimum 2 years of experience serving as a Programmer/Analyst, Systems Analyst, Software Engineer, or comparable technical role.
• Experience testing web-based applications in a production environment.
• Experience performing accessibility testing of websites, web applications, or digital services.
Required Experience• Must have
DHS Trusted Tester Certification• Excellent written and verbal communication skills
• Section 508 Compliance Testing
• WCAG 2.1/2.2 Accessibility Testing
• Assistive Technology Testing (JAWS, NVDA, VoiceOver, etc.)
• HTML, CSS, JavaScript, and
ARIA Fundamentals
• Manual Accessibility Evaluation Techniques
• Functional Software Testing
• Automated Testing Tools (Axe, Accessibility Insights, Selenium, Playwright, WAVE, Lighthouse, or equivalent)
• Test Case Development and Execution
• Accessibility Defect Analysis and Reporting
Desired Skills: (optional)• Generative AI Testing and Evaluation
• Large Language Model (LLM) Validation
• Semantic Search Testing
• Prompt Engineering and AI Response Evaluation
• Azure AI Foundry Experience
• Azure AI Search Experience
• Azure Content Safety Experience
• Azure Monitor and Application Insights Experience
• REST API Testing (Postman or similar tools)
• Agile/Scrum Development Methodologies
