This is not a traditional manual testing role. It is a specialized engineering position focused on validating AI systems, Retrieval-Augmented Generation (RAG) architectures, agent workflows, orchestration frameworks, observability platforms, security controls, and production readiness requirements. The successful candidate will serve as an independent reviewer and certification authority responsible for evaluating the quality and effectiveness of AI-generated outputs and agent behavior.
The AI Quality Engineer will work closely with AI Engineers, Platform Engineers, Architects, Quality Engineering teams, Security, Risk, and Product Owners to develop repeatable evaluation frameworks, testing methodologies, benchmarking standards, and governance processes for enterprise AI solutions. This individual will play a critical role in ensuring AI solutions meet enterprise expectations for accuracy, transparency, auditability, and operational excellence before production deployment.
In addition
AI
Cloud
DevOps platforms, CI/CD pipelines, platform engineering
APIs, microservices, integrations, and distributed systems
AI Testing
Azure AI Services
RAG Evaluation
LangChain/LangGraph/LangSmith
