Details
About the job: This role will own the end-to-end quality strategy for AI Marketplace solutions, including QE agent development, AI validation, workflow orchestration, and platform integration. Define standards for AI testing, observability, security, and performance while enabling rapid adoption of reusable QE agents across projects. Provide technical leadership and mentorship to engineering teams in building and deploying agentic solutions.
What you will do at Sogeti: - Agentic AI Architecture: Understanding AI agents, multi-agent workflows, MCP (Model Context Protocol), orchestration frameworks, tool calling, memory management, RAG patterns, and agent lifecycle management.
- AI/LLM Validation & Assurance: Ability to define and implement testing strategies for AI systems including hallucination detection, response quality evaluation, guardrail testing, prompt validation, grounding verification, and reliability testing.
- QE Automation Engineering: Strong hands-on experience with Playwright, Selenium, API automation, test frameworks, CI/CD integration, test data management, and automation architecture.
- Agent Development & Customization: Ability to configure, extend, and customize agents for project-specific workflows, enterprise tools, APIs, business rules, and testing use cases.
- AI Observability & Monitoring: Knowledge of agent telemetry, trace analysis, execution monitoring, prompt/response tracking, drift detection, performance analytics, and operational dashboards.
- Cloud & Platform Engineering: Working knowledge of Azure AI, AWS Bedrock, OpenAI, Databricks, Kubernetes, containers, APIs, security integrations, and enterprise deployment patterns.
- Data & API Engineering: Strong understanding of API contracts, service orchestration, structured/unstructured data, vector databases, embeddings, and data validation techniques.
- Responsible AI & Governance: Understanding AI agents, multi-agent workflows, MCP (Model Context Protocol), orchestration frameworks, tool calling, memory management, RAG patterns, and agent lifecycle management.
- Performance & Scalability Testing: Ability to validate agent response latency, concurrency, token consumption, workflow scalability, resiliency, and failover behavior.
- Solution Architecture & Consulting: Capability to translate business use cases into agentic solutions, define reusable marketplace assets, establish standards, and mentor engineering teams.
What you will bring:- Agentic AI / LLM fundamentals
- API testing and integration
- AI testing and validation
- Azure AI/OpenAI ecosystem
- Strong QE architecture background
- LangChain / LangGraph
- AutoGen / CrewAI / Semantic Kernel
- Vector databases
- MCP-based architectures
- Kubernetes & containers
- Prompt engineering
Education: - Bachelor's or Master's degree in Computer Science, Software Engineering, Information Systems, Business Administration, or a related field.
Life at Sogeti - Sogeti supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:
- Flexible work options
- 401(k) with 150% match up to 6%
- Employee Share Ownership Plan
- Medical, Prescription, Dental & Vision Insurance
- Life Insurance
- 100% Company-Paid Mobile Phone Plan
- 3 Weeks PTO + 7 Paid Holidays
- Paid Parental Leave
- Adoption, Surrogacy & Cryopreservation Assistance
- Subsidized Back-up Child/Elder Care & Tutoring
- Career Planning & Coaching
- $5,250 Tuition Reimbursement & 20,000+ Online Courses
- Employee Resource Groups
- Counseling & Support for Physical, Financial, Emotional & Spiritual Well-being
- Disaster Relief Programs
