Gen AI Architect

Persistent Systems Limited

$150K — $180K *
Enterprise Technology
11 - 15 years of experience
Job Overview by Ladders

Qualifications

  • 15+ years of software and solution architecture experience
  • Hands-on expertise in Data Science, Machine Learning, and agent-based AI systems
  • Proven experience in designing multi-agent systems using specific frameworks
  • Strong understanding of cloud AI platforms like AWS, Azure, and Google Vertex AI
  • Proficient in Python and optionally Java/Node.js
  • Experience with Docker, Kubernetes, and CI/CD pipelines
  • Exceptional communication and presentation skills

Responsibilities

  • Design and implement Agentic AI systems utilizing frameworks like AutoGen and LangGraph
  • Create and maintain intelligent agent ecosystems for collaborative tasks
  • Optimize prompt flows for scalable LLM-driven systems
  • Architect RAG pipelines and deploy using vector databases
  • Implement end-to-end operational pipelines for GenAI applications
  • Design microservices-based architecture with security measures
  • Collaborate with cross-functional teams and lead enterprise AI architecture initiatives

Benefits

  • Competitive salary and benefits package
  • Opportunities for talent development and company-sponsored higher education
  • Access to cutting-edge technologies
  • Employee engagement initiatives including flexible work hours
  • Annual health check-ups covered
  • Comprehensive insurance coverage for employees and their families
Full Job Description
Job Description

About Position:

a { text-decoration: none; color: #464feb; } tr th, tr td { border: 1px solid #e6e6e6; } tr th { background-color: #f5f5f5; }

We are seeking a highly experienced Agentic AI / Generative AI Architect with 15+ years of software and solution architecture experience, combined with hands?on expertise in Data Science, Machine Learning, and modern agent-based AI systems. This role requires deep technical leadership in designing, implementing, and governing advanced multi-agent AI ecosystems, RAG pipelines, cloud-native AI platforms, and GenAI engineering practices. The ideal candidate will drive end?to?end solution architecture for enterprise-grade AI applications while ensuring scalability, robustness, security, and operational excellence.

  • Role: Gen AI Architect
  • Job Location: Bridgewater, NJ
  • Experience: 12 to 15 Years
  • Job Type: Full Time Employment

What You'll Do:

  • Design & Implement Agentic AI Systems
  • Architect and build multi-agent, goal-driven, autonomous AI systems using frameworks such as:
    • AutoGen
    • LangGraph
    • CrewAI
  • Create intelligent agent ecosystems supporting orchestration, reasoning, and collaborative task execution.
  • Prompt Engineering & LLM Expertise
  • Apply advanced prompt engineering techniques including:
    • Few-shot prompting
    • Chain-of-thought reasoning
    • Prompt templates
  • Optimize prompt flows for deterministic, scalable LLM-driven systems
  • Cloud-Native AI Architecture
  • Design and deploy AI/LLM systems on cloud platforms such as AWS Bedrock, Azure OpenAI, Google Vertex AI, etc.
  • Ensure solutions meet enterprise NFRs including performance, security, cost-optimization, and availability.
  • RAG Pipelines, Vector Databases & MCP
  • Architect and deploy RAG pipelines using vector databases such as:
    • Pinecone
    • Weaviate
    • ChromaDB
    • FAISS
  • Implement MCP Servers and Agent-to-Agent (A2A) communication frameworks.
  • LMOPs / GenAIOPs
  • Implement end-to-end operational pipelines for GenAI applications including:
    • Continuous integration & deployment
    • Model monitoring & drift detection
    • Logging, observability, and troubleshooting mechanisms
  • Establish governance models, reusable patterns, and GenAI best practices.
  • Application & Microservices Architecture
  • Design microservices-based systems using Spring Boot, REST APIs, and secure API design patterns.
  • Implement API security, versioning, and distributed system governance.
  • Architect cloud-native applications using AWS/Azure/GCP, Spring Cloud, PCF, or equivalent.
  • Collaboration & Leadership
  • Work closely with Data Scientists, Product Owners, Business SMEs, and Engineering teams.
  • Lead end-to-end solution architecture for enterprise AI initiatives.
  • Conduct technical presentations, architectural reviews, and stakeholder communication.

Expertise You'll Bring:

  • 5+ years in software/solution architecture.
  • Proven experience as a Data Scientist or ML Engineer with exposure to agentic AI systems.
  • Experience designing multi-agent systems using AutoGen, LangGraph, CrewAI, etc.
  • Strong understanding of cloud AI platforms (Bedrock, Azure OpenAI, Vertex AI).
  • Hands-on experience with AI Code Assist tools such as:
    • GitHub Copilot
    • Windsurf
    • Cursor
    • AWS Q
  • Expertise in Vector Databases, RAG pipelines, MCP, and multi-agent communication.
  • Strong proficiency in Python (preferred), and optionally Java/Node.js.
  • Experience with microservices, Spring Boot, REST APIs, API security, and versioning.
  • Proficiency in Docker, Kubernetes, CI/CD pipelines. a { text-decoration: none; color: #464feb; } tr th, tr td { border: 1px solid #e6e6e6; } tr th { background-color: #f5f5f5; }
  • Strong grasp of design patterns and architecture principles.
  • Deep understanding of cloud-native design and distributed systems.
  • Experience designing AI systems that meet NFRs: scalability, security, performance, maintainability.
  • a { text-decoration: none; color: #464feb; } tr th, tr td { border: 1px solid #e6e6e6; } tr th { background-color: #f5f5f5; }
  • Exceptional communication and presentation skills.
  • Ability to articulate complex AI concepts to technical and non-technical audiences.
  • Strong leadership, problem-solving mindset, and strategic thinking abilities.
  • Ability to collaborate with cross-functional teams to translate business needs into AI-powered solutions.

Benefits:

  • Competitive salary and benefits package
  • Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
  • Opportunity to work with cutting-edge technologies
  • Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
  • Annual health check-ups
  • Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

  • We support hybrid work and flexible hours to fit diverse lifestyles.
  • Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
  • If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let?s unleash your full potential at Persistent - persistent.com/careers

Similar Jobs

More Jobs at Persistent Systems Limited

  • Java Lead
    $120K — $145K *
    Dallas, TX 75217 (Dallas County)
    Information Technology
    In-Person
  • Java Lead
    $125K — $150K *
    Austin, TX 78745 (Travis County)
    Information Technology
    In-Person
  • Gen AI Architect
    $150K — $180K *
    Bridgewater, NJ 08807 (Somerset County)
    Enterprise Technology
    In-Person
  • Principal Architect
    $150K — $180K *
    Bridgewater, NJ 08807 (Somerset County)
    Information Technology
    In-Person
  • GCP Cloud Solution Architect
    $150K — $180K *
    Dallas, TX 75217 (Dallas County)
    Information Technology
    In-Person

More Enterprise Technology Jobs

Find similar Gen AI Architect jobs: