AI QE Architect

Compunnel

$135K — $160K *
Enterprise Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of hands-on experience with LLMs and AI frameworks.
  • Proficient in Python, TypeScript, or Java for automation engineering.
  • Strong skills in automation frameworks and UI automation tools like Playwright or Selenium.
  • Experience with CI/CD processes using GitHub Actions or Azure DevOps.
  • Familiarity with cloud platforms (AWS, Azure, GCP) and their AI services.
  • Skilled in model evaluation and performance testing with tools like JMeter.
  • Understanding of data pipelines for optimized retrieval in RAG systems.

Responsibilities

  • Design and optimize AI-driven quality engineering solutions.
  • Implement context-aware automation using MCP-driven intelligence.
  • Build and maintain automation frameworks for comprehensive testing.
  • Develop prompt-optimized AI-generated test assets.
  • Lead defect triage and ensure compliance with QE governance.
  • Collaborate across teams to align on architecture and technology roadmaps.
  • Provide technical leadership and mentorship in AI automation best practices.

Benefits

  • Technical leadership opportunities in a cutting-edge AI environment.
  • Collaborative work culture within Agile/Scrum development teams.
  • Exposure to innovative AI tools and automation frameworks.
  • Professional development through mentorship and strategic initiatives.
Full Job Description
Job Summary
We are seeking an AI QE Architect to lead the design, development, and optimization of next-generation AI-powered quality engineering solutions and platforms. This role combines deep technical expertise in automation engineering with hands-on experience in LLMs, agentic AI frameworks, and enterprise-grade AI tooling. The architect will define strategy, design scalable frameworks, guide teams, and drive innovation across QE automation, AI agents, RAG pipelines, and MCP-enabled intelligent workflows.

Key Responsibilities
• Design, develop, and optimize AI-powered quality engineering solutions and scalable automation platforms.
• Apply hands-on experience with LLMs, prompt engineering, RAG, vector databases, and model evaluation.
• Develop and enhance GenAI-powered QE solutions, AI agents, and autonomous workflows.
• Implement MCP-driven, context-aware automation and CI/CD decision intelligence.
• Design and maintain automation frameworks for UI, API, and performance testing.
• Develop prompt-optimized, AI-generated test assets and validation mechanisms.
• Build data and embedding pipelines and optimize retrieval capabilities for RAG solutions.
• Implement CI/CD processes for ML models, including versioning, evaluation, and retraining workflows.
• Integrate automation pipelines using GitHub Actions, Azure DevOps, Jenkins, and related tools.
• Ensure AI and automation environments are scalable, secure, and governed.
• Provide technical leadership and mentor teams on AI adoption and automation engineering best practices.
• Collaborate with developers, SMEs, and product teams to align architecture and technology roadmaps.
• Drive feature prioritization, quality strategy, and solution design.
• Lead defect triage, quality reviews, and compliance with QE and AI governance requirements.
• Contribute across the full SDLC, including test strategy, design, execution, and analysis.
• Operate effectively within Agile/Scrum development environments.

Required Qualifications
• Strong hands-on experience with LLMs, prompt engineering, RAG, vector databases, and model evaluation.
• Proficiency with LangChain, HuggingFace, Transformers, and OpenAI/Ollama APIs.
• Experience with agentic AI frameworks such as LangGraph, AutoGen, or CrewAI.
• Strong programming skills in Python, TypeScript, or Java.
• Experience architecting and maintaining automation frameworks.
• Hands-on experience with UI automation tools such as Playwright and Selenium.
• Experience with API testing tools and frameworks such as PyTest, Requests, and RestAssured.
• Experience with performance testing tools such as JMeter and Locust.
• Experience with PyTorch, TensorFlow, Scikit-Learn, and NLP/CV libraries such as NLTK, BART, or OpenCV.
• Experience building data and embedding pipelines and optimizing retrieval for RAG.
• Strong understanding of AWS, Azure, or GCP architectures and AI/ML services.
• Experience integrating automation and CI/CD pipelines using GitHub Actions, Azure DevOps, Jenkins, or similar tools.
• Strong understanding of scalable, secure, and governed AI and automation environments.
• Experience working across the full SDLC in an Agile/Scrum environment.

Preferred Qualifications
• Experience designing enterprise-grade AI-powered quality engineering platforms.
• Experience with MCP-enabled intelligent workflows and context-aware automation.
• Experience implementing AI-generated testing assets and automated validation mechanisms.
• Experience with ML model versioning, evaluation, and retraining workflows.
• Experience providing technical leadership and mentoring engineering teams.
• Experience driving AI adoption, QE strategy, and automation innovation across enterprise environments.

Similar Jobs

More Jobs at Compunnel

  • Data Engineer
    $120K — $145K *
    Dallas, TX 75217 (Dallas County)
    Information Technology
    In-Person
  • Delivery Manager II
    $90K — $110K *
    Atlanta, GA 30349 (Fulton County)
    Healthcare
    In-Person
  • QA Tester
    $90K — $110K *
    Toronto, ON M3C 0E3
    Information Technology
    In-Person
  • Lead Software Tester
    $80K — $95K *
    Columbus, GA 31907 (Muscogee County)
    Information Technology
    In-Person
  • Full Stack Developer .NET- Onshore
    $110K — $130K *
    Aliso Viejo, CA 92656 (Orange County)
    Information Technology
    In-Person

More Enterprise Technology Jobs

Find similar AI QE Architect jobs: