Cognizant

Gen AI Architect ( Agentic AI & LLM) (Remote)

Cognizant$102K — $162K *
US-AnywhereRemote in New York, NY
Consumer Technology
11 - 15 years of experience
Job Overview by Ladders

Qualifications

  • 12+ years of experience in large-scale distributed systems or complex software applications.
  • Proven track record with production-grade AI and LLM-powered solutions.
  • Deep expertise in Generative AI technologies, including prompt engineering and vector databases.
  • Hands-on experience with frameworks such as LangGraph and LangChain.
  • Strong full-stack engineering background, proficient in ReactJS and Node.js.
  • Ability to define technical strategy and mentor teams in architecture decisions.
  • Solid understanding of software engineering principles, including scalability and performance.

Responsibilities

  • Architect and develop enterprise-scale Generative AI applications utilizing LLMs and automation.
  • Design and implement Agentic AI solutions for complex reasoning and workflow integration.
  • Build scalable workflow orchestration solutions using technologies like Temporal.
  • Define AI platform architectures including governance and production deployment.
  • Establish frameworks for evaluating AI solutions and measuring business outcomes.
  • Lead end-to-end product delivery from architecture to operational support.
  • Drive best practices focusing on scalability and reliability in engineering.

Benefits

  • Medical/Dental/Vision/Life Insurance
  • Paid holidays plus Paid Time Off
  • 401(k) plan and contributions
  • Long-term/Short-term Disability
  • Paid Parental Leave
  • Employee Stock Purchase Plan
Full Job Description
Gen AI Architect (Agentic AI & LLM) (Remote)

About the role

As a Gen AI Architect ( Agentic AI & LLM) you will play a key role in designing and delivering next-generation AI-powered enterprise applications. You will lead the architecture and development of scalable Generative AI solutions, leveraging Large Language Models (LLMs), Agentic AI frameworks, modern web technologies, and distributed systems.

Working across engineering, product, and business teams, you will define technical strategy, establish architectural standards, mentor engineers, and deliver innovative AI solutions that create measurable business value.

In this role, you will:
  • Architect and develop enterprise-scale Generative AI applications utilizing LLMs, RAG, structured data, workflow automation, and intelligent orchestration.
  • Design and implement Agentic AI solutions using LangGraph, LangChain, or similar frameworks to support complex reasoning, memory management, tool integration, and human-in-the-loop workflows.
  • Build scalable and fault-tolerant workflow orchestration solutions using Temporal or similar technologies.
  • Define AI platform architectures covering model routing, prompt lifecycle management, observability, experimentation, governance, and production deployment.
  • Establish evaluation frameworks for AI solutions, including offline testing, regression analysis, trace diagnostics, and business outcome measurement.
  • Lead end-to-end product delivery, from architecture and development through deployment and operational support.
  • Drive engineering best practices focused on scalability, performance, reliability, security, and maintainability.
  • Mentor engineering teams and foster a culture of innovation, technical excellence, and continuous learning.

Work model

We strive to provide flexibility wherever possible. Based on this role's business requirements, this is a remote position open to qualified applicants in the United States. Regardless of your working arrangement, we are here to support a healthy work-life balance through our various wellbeing programs.

The working arrangements for this role are accurate as of the date of posting. This may change based on the project you're engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations

*Please note that this position is not eligible for visa transfer or sponsorship now or at any time in the future*

What you need to have to be considered:
  • 12+ years of experience designing and delivering large-scale distributed systems, enterprise platforms, or complex software applications.
  • Proven success delivering production-grade AI and LLM-powered solutions, including agentic AI systems, RAG platforms, intelligent automation, or conversational AI applications.
  • Deep expertise with Generative AI technologies including OpenAI models, prompt engineering, vector databases, retrieval frameworks, and AI orchestration patterns.
  • Hands-on experience with LangGraph, LangChain, AutoGen, or similar agent development frameworks.
  • Strong full-stack engineering background with expertise in ReactJS, Node.js, and modern application architecture.
  • Demonstrated ability to define technical strategy, influence architecture decisions, and mentor engineering teams.
  • Strong software engineering fundamentals, including system design, scalability, testing, performance optimization, and code quality practices.
  • Bachelor's, Master's, or PhD degree in Computer Science, Engineering, or a related discipline, or equivalent practical experience.

These will help you stand out:
  • Experience building AI governance, observability, monitoring, and evaluation frameworks for enterprise environments.
  • Expertise with workflow orchestration technologies such as Temporal.
  • Experience implementing model experimentation, prompt versioning, and AI production rollout strategies.
  • Knowledge of cloud-native architectures and enterprise-scale application modernization initiatives.
  • Passion for emerging AI technologies and a demonstrated history of driving innovation across engineering organizations.

Salary and Other Compensation:

Applications will be accepted until October 9th, 2026.

The annual salary for this position is between $ 102.600 to $162,500 depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant's discretionary annual incentive program, based on performance and subject to the terms of Cognizant's applicable plans.

Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:
  • Medical/Dental/Vision/Life Insurance
  • Paid holidays plus Paid Time Off
  • 401(k) plan and contributions
  • Long-term/Short-term Disability
  • Paid Parental Leave
  • Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.

About Cognizant

TriZetto is Powering Integrated Healthcare Management. With technology solutions touching more than half the U.S. population today, TriZetto is uniquely positioned to drive the convergence of core benefit administration, care management and constituent engagement. TriZetto provides premier information technology solutions that enable payers and other constituents in the healthcare supply chain to improve the coordination of benefits and care for healthcare consumers.

Cognizant Careers

Join the vibrant team at Cognizant, a leading provider of information technology, consulting, and business process services. Cognizant is not just a company; it's a community where innovation, leadership, and diversity are valued and where every team member is encouraged to thrive.

Work You’ll Do

At Cognizant, we are dedicated to helping the world's leading companies build stronger businesses — not just for today but for the future. This commitment to growth and sustainability is what makes Cognizant a unique place to advance your career.

Explore Job Opportunities

Whether you're looking for an entry-level position or a more senior role, Cognizant offers a plethora of job opportunities that could be perfect for you. Our hiring process is designed to be transparent and engaging, ensuring that every candidate is able to showcase their skills and potential fully.

Innovative Work

Join a team where innovation is at the core of everything we do. Cognizant’s professionals are not just part of a company; they're part of a groundbreaking environment that combines technology, insights, and leadership to foster innovation across global industries.

Internship Programs

Kickstart your career with Cognizant’s internship programs. These opportunities allow you to gain hands-on experience, develop your professional skills, and network with experts in your field. An internship at Cognizant is a stepping stone to full-time employment and a chance to see how your studies apply in the real world.

Professional Growth and Development

Cognizant is committed to the professional growth of its employees. With access to cutting-edge training, leadership programs, and diversity initiatives, you can build a career that’s equipped for the demands of tomorrow’s business landscape.

Benefits and Culture

Our employees enjoy a range of benefits designed to support their physical, financial, and emotional well-being. Cognizant’s culture is built on a foundation of respect and inclusivity, where everyone’s contribution is valued. Join us and be part of a team that celebrates diversity and is driven to make a positive impact on the world.

Stay Connected

Join Our Team Search open positions that match your skills and interests. We look for passionate, curious, creative, and solution-driven team players. Ready to take the next step in your career journey? Explore the exciting employment and career opportunities waiting for you at Cognizant.

Keep Up to Date

Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work here.

Job Alert Emails

Personalize your subscription to receive job alerts, latest news, and insider tips tailored to your preferences. Discover the rewarding opportunities that await at Cognizant.

Networking and Interviews

Enhance your career prospects at Cognizant through our robust networking events. Prepare your resume, sharpen your interview skills, and connect with leaders across the industry to unlock new career paths. At Cognizant, we don’t just offer jobs; we offer career journeys. Be part of a team that’s committed to your long-term career growth and professional development. Join Cognizant today and be a part of our success story.
Learn more about Cognizant
Size
340,400 employees
Market Cap
$28.7 billion
Industry
Net Income
$1.3 billion
Founded
1994
5 Year Trend
+6.5%
Revenue
$16.6 billion
NASDAQ

Similar Jobs

More Jobs at Cognizant

More Consumer Technology Jobs

Find similar Gen AI Architect ( Agentic AI & LLM) (Remote) jobs: