Job Summary
We are seeking an innovative AI Software Development Engineer in Test (AI-SDET) to join the quality engineering team. This role will bridge traditional quality assurance and artificial intelligence by designing self-healing test automation frameworks, validating Large Language Models (LLMs), and integrating AI agents into CI/CD processes. The ideal candidate will have strong experience in software quality engineering, test automation, and AI/ML development.
Key Responsibilities
• Architect and maintain enterprise-grade, scalable automation frameworks.
• Build intelligent test agents, automated prompt-engineering validators, and self-healing test execution scripts.
• Design and maintain evaluation frameworks covering hallucination detection, groundedness, toxicity, bias, and safety guardrails.
• Design AI-driven synthetic data generation pipelines to simulate complex, production-like testing scenarios.
• Validate RAG (Retrieval-Augmented Generation) architectures, embedding quality, retrieval accuracy, and vector search relevance.
• Build intelligent test selection and impact analysis systems that predict which test suites should run based on specific code changes.
• Develop and enhance scalable, robust automation scripts for UI, API, and backend validation using modern languages and frameworks.
• Work alongside MLOps teams to build continuous testing and automated verification pipelines.
• Collaborate with cross-functional stakeholders to identify and implement improvements to testing processes and systems.
Required Qualifications
• Bachelor's degree in Computer Science or a related field.
• 6 to 8 years of hands-on experience in software quality engineering, test automation, and AI/ML development.
• Willingness to participate in a mandatory onsite interview at the client location.
• Proficiency in Python, Java, or Scala.
• Proficiency with modern testing tools such as Playwright.
• Experience with LLM APIs such as Claude and OpenAI and agent frameworks such as LangChain.
• Experience with cloud-based platforms with AI integration, including Azure OpenAI and AWS AI services.
• Strong understanding of CI/CD pipelines and containerization using Docker.
• Strong experience validating complex RESTful APIs, microservices, and databases, including SQL and NoSQL.
• Strong analytical and problem-solving skills with an interest in adopting new AI technologies.
• Excellent communication and collaboration skills.
• Ability to propose and implement improvements in systems and processes.
• Ability to work effectively with cross-functional stakeholders.
Preferred Qualifications
• Experience working within the retail domain is preferred.
