EXL Service

Agentic AI Architect

EXL Service • $130K — $180K *
Jersey City, NJ 07305In-Person
Enterprise Technology
Less than 5 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 5-7 years experience in AI and integration frameworks
  • Proficiency in GenAI, large language models, and prompt engineering
  • Expertise in Azure AI Search and retrieval optimization techniques
  • Experience with MCP architecture and API design
  • Strong understanding of AI safety protocols and governance
  • Background in DevOps practices including CI/CD pipelines
  • Educational background in Computer Science, Engineering, Data Science, or related field

Responsibilities

  • Define the overall architecture for an agentic AI platform
  • Design and govern orchestration frameworks for production workflows
  • Establish architectural patterns for retrieval and grounding
  • Implement best practices for large-scale agentic coding
  • Develop integration architectures across various systems
  • Design metadata-driven frameworks for onboarding
  • Lead the establishment of AI safety and guardrails

Benefits

  • Comprehensive health insurance
  • Retirement savings plan with company matching
  • Flexible work hours and remote work options
  • Professional development and training opportunities
  • Generous paid time off and holidays
Full Job Description
Job Description

Technical skills:
  • GenAI & Agentic Frameworks - Semantic Kernel/ LangGraph (or similar orchestration frameworks); LLM integration (Azure OpenAI, OpenAI APIs, etc.); Prompt engineering, prompt lifecycle design
  • Retrieval & RAG - Azure AI Search (indexing, vector search, hybrid search); Embedding pipelines and retrieval optimization; RAG design, grounding strategies, context management
  • Tool Access & Integration - MCP (Model Context Protocol) architecture and tool design; API design (FastAPI / REST / microservices); Integration with enterprise systems and third-party APIs
  • AI Safety & Governance - NVIDIA NeMo Guardrails;Microsoft Presidio (PII detection/masking); Guardrails for prompt injection, hallucination control
  • Evaluation & ModelOps - Azure AI Foundry (model hosting, versioning, monitoring); Evaluation frameworks (LLM-as-judge, test datasets); Prompt/version control, cost/latency monitoring
  • DevOps & Observability - CI/CD pipelines (Azure DevOps / GitHub Actions); Logging, monitoring, observability (App Insights, etc.); Performance tuning and scalability


Responsibilities

Role & Responsibilities Overview:
  • Architecture & Technical Leadership
  • Define end-to-end architecture for agentic AI-enabled platform across data, AI, orchestration, and integration layers with some real hands-on experience doing POCs
  • Design and govern agentic orchestration framework for multi-step production workflows
  • Establish architecture patterns for - RAG and grounding, Vector search and retrieval, MCP tool access layer, prompt management and evaluation
  • Have a deep understanding of Agentic coding and best practices of using Agentic coding for large scale implementations
  • Familiarity in implementing A2A or similar frameworks in a large scale environment
  • Platform & Integration Design
  • Define integration architecture across - Lakehouse, ODS, document systems, Underwriting systems and third-party APIs
  • Design configurable, metadata-driven framework for multi-LOB onboarding
  • Define API/microservices patterns (Python/.NET hybrid)
  • AI & GenAI Enablement
  • Define where and how to use - GenAI vs deterministic logic, agentic workflows vs pipeline workflows
  • Establish multimodal integration approach combining structured, unstructured, and external data
  • Design prompt lifecycle, evaluation, and optimization strategy
  • Governance, Safety & ModelOps
  • Define AI safety and guardrails (PII, hallucination control, policy constraints)
  • Establish ModelOps and PromptOps frameworks
  • Ensure explainability, auditability, and traceability of AI outputs
  • Program Leadership
  • Lead technical execution across AI, data, and platform teams
  • Guide engineers (AI, data, full-stack) and ensure alignment with architecture
  • Drive technical decisions and stakeholder communication


Qualifications

  • Education: Bachelor's or Master's in Computer Science, Engineering, Data Science, or related field

About EXL Service

EXL Service is a leading operations management and analytics company that helps businesses enhance growth and profitability. The company provides services in areas such as finance and accounting, customer service, and healthcare. EXL Service was founded in 1999 and is headquartered in New York, New York.
Learn more about EXL Service
Size
31,000 employees
Industry
Business Services
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at EXL Service

More Enterprise Technology Jobs

Find similar Agentic AI Architect jobs:

NationwideJersey City, NJ