Must Have Technical/Functional Skills
Primary Skill: Test AI applications, RAG systems, agents, APIs and Data Pipeline using automated development framework
Experience: Minimum 8 years
Roles & Responsibilities
Bachelors or masters degree in computer science or related field.
Key Responsibilities
• Lead Strategy: Design end-to-end test plans for generative AI, LLMs, and machine learning models.
• Model Validation: Test models for accuracy, drift, latency, robustness, and security vulnerabilities.
• Automation: Build advanced test automation frameworks using Python, PyTest, and specialized AI testing tools.
• Data Quality: Validate training, validation, and test datasets for bias, leakage, and data integrity.
• Performance Testing: Evaluate system scalability and response times under heavy concurrent loads.
• Team Leadership: Mentor junior engineers and collaborate with data scientists and software developers.
• Certifications in Automation
Salary Range: $100,000 120,000 a year
