NTT DATA  Services

AI Architect

NTT DATA Services$130K — $180K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 10+ years of experience in AI architecture and design
  • Deep expertise in Retrieval-Augmented Generation (RAG) and Agentic AI architecture
  • Experience with AWS and Azure platforms
  • Proven ability to implement governance and compliance measures in AI systems
  • Strong background in MLOps, containerization, and CI/CD frameworks

Responsibilities

  • Design end-to-end AI solution architectures for enterprise systems
  • Integrate AI/ML features into legacy and cloud-native applications
  • Establish governance and compliance standards for AI solutions
  • Develop scalable CI/CD pipelines for AI and ML models
  • Serve as a thought leader and mentor in AI practices

Benefits

  • Flexibility to work in Dallas, Texas
  • Opportunity to lead large-scale AI initiatives
  • Access to cutting-edge AI technologies and platforms
  • Collaborative work environment with cross-functional teams
  • Chance to shape the future of AI integration within enterprise systems
Full Job Description
Req ID: 375661

We are currently seeking a AI Architect to join our team in Dallas, Texas (US-TX), United States (US).

Job Title: AI Architect
Experience level: 10 + years
Job Summary

We are seeking an experienced AI Architect to design and lead enterprise-scale AI, ML, and Generative AI solutions built on AWS and Azure as the core AI foundation, with Microsoft Copilot as the primary user experience layer. The role is responsible for designing the end-to-end AI solution architecture, ensuring alignment with enterprise systems, scalability, and governance standards while integrating AI into the broader IT landscape. It requires deep expertise in RAG (Retrieval-Augmented Generation) and Agentic AI architecture on cloud-native platforms, enabling intelligent, scalable, and production-ready AI systems after understanding the current product architecture. The candidate should also be able to conduct POCs to demonstrate proof of design considerations.

Platform & Enablement Roles
  • AI Platform Admin (M365, copilot Studio) Manages AI platforms and environments, including access provisioning, governance controls, and policy enforcement (e.g., DLP, security, and compliance).
  • AI Reusable Utility Develops reusable components (e.g., prompts, connectors, APIs, templates) to accelerate AI solution delivery and promote standardization across use cases.
  • AI Common Infrastructure, Framework & Observability Architect (AWS and Azure) Designs and maintains the foundational AI infrastructure, frameworks, and observability capabilities (telemetry, monitoring, metrics) required for scalable, reliable, and governed AI operations.

Core Responsibilities
  1. Architectural Design: Define the end-to-end blueprints spanning data ingestion, model training, inference, and continuous monitoring. design end-to-end artificial intelligence solutions ensuring models scale efficiently align with enterprise systems and meet governance standards. They act as the vital bridge linking theoretical AI models built by data scientists with production-ready, secure applications integrated into the broader IT landscape.
  1. Enterprise Integration: Seamlessly embed AI/ML features and multi-agent workflows into legacy applications, ERPs, and cloud-native systems.
  2. Governance & Compliance: Implement ethical AI guardrails, model risk management, data privacy protections and explainability standards.
  3. Scalability & MLOps: Establish CI/CD for AI, model versioning, automated retraining, and drift detection to prevent performance degradation.
  4. Tech Stack Strategy: Make crucial "build vs. buy" decisions for infrastructure, weighing tradeoffs of on-premises, hybrid, and cloud environments.
  5. Leadership & Collaboration:
    • Serve as a technical thought leader for AI, GenAI, and data platforms.
    • Mentor data scientists, ML engineers, and data engineers.
    • Collaborate with business and product teams to translate requirements into AI-driven solutions.
    • Evaluate emerging AI technologies and guide strategic adoption.
  1. AI, ML & GenAI Architecture
    • Design and define end-to-end AI solution architectures covering data ingestion, model training, deployment, monitoring, and governance, ensuring alignment with enterprise systems and IT landscape while meeting scalability and governance standards.
    • Design scalable, cloud-native AI platforms on AWS and Azure.
    • Architect solutions for both batch and real-time inference workloads.
  1. RAG (Retrieval-Augmented Generation)
    • Architect and implement RAG pipelines using structured and unstructured enterprise data.
    • Design ingestion, chunking, embedding, and retrieval strategies for RAG systems.
    • Integrate vector databases (e.g., Pinecone, FAISS, Milvus, Azure AI Search, Amazon OpenSearch).
    • Ensure relevance, freshness, observability, and security of RAG-based AI systems.
  2. Agentic AI & Autonomous Systems
    • Design Agentic AI architecture enabling autonomous decision-making and task execution.
    • Orchestrate multi-agent systems using tools, memory, and reasoning workflows.
    • Implement guardrails, human-in-the-loop controls, and observability for agent-based systems.
    • Enable enterprise use cases such as AI assistants, Microsoft Copilot-integrated workflows, task automation, and decision intelligence.
  1. MLOps & LLMOps
    • Define and implement MLOps / LLMOps frameworks for CI/CD, versioning, monitoring, and drift detection.
    • Enable experimentation, evaluation, and governance of ML models and LLM-based systems.
    • Ensure compliance with security, privacy, and responsible AI guidelines.
  2. Cloud & Platform Engineering
    • Architect AI solutions on AWS and Azure as the primary cloud platforms, integrating Microsoft Copilot as the enterprise user experience layer.
    • Integrate AI platforms with enterprise applications, APIs, and data sources.
    • Design highly available, secure, and scalable AI systems.


Required Skills
  • Engineering Foundation: 7+ years of deep knowledge of MLOps, containerization (Docker/Kubernetes), and CI/CD pipelines.
  • Cloud Platforms: 5+ years of advanced expertise in deploying on major hyperscalers like AWS Machine Learning, Azure AI, or Google Vertex AI.
  • Data Management: 5+ years of Proficiency in designing feature stores, vector databases, and real-time/batch data pipelines.
  • AI/ML Frameworks: 3 to 5 years of familiarity with concepts like Large Language Models (LLMs), Generative AI, Retrieval-Augmented Generation (RAG), and frameworks like PyTorch or TensorFlow.

#LI-NorthAmerica

About NTT DATA Services

NTT DATA Corporation is a Japanese multinational information technology service and consulting company headquartered in Tokyo, Japan. It is partially-owned subsidiary of Nippon Telegraph and Telephone. Japan Telegraph and Telephone Public Corporation, a predecessor of NTT, started Data Communications business in 1967. NTT, following its privatization in 1985, spun off the Data Communications division as NTT DATA in 1988, which has now become the largest of the IT Services companies headquartered in Japan.
Learn more about NTT DATA Services
Size
151,991 employees
Industry
Founded
1988
NASDAQ

Similar Jobs

More Jobs at NTT DATA Services

More Enterprise Technology Jobs

Find similar AI Architect jobs: