Azure Solution/Data Architect

The Nippon Telegraph and Telephone Corporation (NTT)

$166K — $187K *
US-AnywhereRemote in Toronto, ON
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8+ years of experience with Microsoft Azure.
  • 8+ years in data architecture and distributed systems.
  • 5+ years with Azure Data Factory, Azure Synapse, or Azure Databricks.
  • Strong understanding of Large Language Models (LLMs) and prompt engineering.
  • 5+ years in building AI-powered applications and agentic systems.
  • Experience with Azure OpenAI APIs and vector databases like Azure AI Search.
  • 5+ years proficiency in Python and SQL.

Responsibilities

  • Design end-to-end cloud solutions with Microsoft Azure services.
  • Architect AI-enabled and agentic solutions for autonomous task execution.
  • Define architecture patterns integrating LLMs, APIs, and enterprise systems.
  • Ensure solutions maintain scalability, fault tolerance, and cost effectiveness.
  • Develop frameworks for AI agents using tools like Azure OpenAI and LangChain.
  • Build multi-agent systems for task planning and context-aware decision-making.
  • Create RAG pipelines using Azure-related vector databases and ensure responsible AI governance.

Benefits

  • Access to Employee Assistance Program (EAP).
  • Employee Discount Perks.
Full Job Description
NTT DATA's Client is seeking an experienced Azure Solution/Data Architect with strong expertise in AI-driven and agentic systems to design and implement scalable cloud and data solutions on Microsoft Azure. The ideal candidate will have a deep understanding of modern data platforms combined with experience in Generative AI, LLMs, and autonomous AI agents, enabling intelligent, self-orchestrating business workflows and decision systems.

Day to Day job Duties: (what this person will do on a daily/weekly basis)

  • Design end-to-end cloud solutions using Microsoft Azure services.
  • Architect AI-enabled and agentic solutions that can autonomously perform tasks, orchestrate workflows, and make decisions.
  • Define architecture patterns for integrating LLMs, APIs, and enterprise systems.
  • Ensure scalability, fault tolerance, and cost efficiency.
  • Design and implement AI agent frameworks using tools such as:
  • Azure OpenAI Service
  • Semantic Kernel / LangChain
  • Copilot frameworks
  • Build multi-agent systems capable of:
  • Task planning and execution
  • Tool usage and orchestration
  • Context-aware decision-making
  • Develop RAG (Retrieval Augmented Generation) pipelines using vector databases (Azure AI Search, Cosmos DB, etc.).
  • Integrate AI agents with enterprise data platforms and business applications.
  • Ensure responsible AI practices, guardrails, and governance.
  • Work with Azure services including:
  • Azure Data Factory (ADF)
  • Azure Synapse Analytics
  • Azure Databricks
  • Azure AI Services / Azure OpenAI
  • Azure Data Lake Storage (ADLS Gen2)
  • Azure SQL / Cosmos DB
  • Set up CI/CD pipelines using Azure DevOps/GitHub Actions.


Basic Qualifications: (what are the skills required to this job with minimum years of experience on each)
  • 8+ years of strong expertise in Microsoft Azure.
  • 8+ years experience in data architecture and distributed systems.
  • 5+ years experience with:
  • Azure Data Factory / Synapse / Databricks
  • Data modeling techniques (Dimensional, Data Vault)
  • 5+ years' experience building AI-powered or agentic applications.
  • Strong understanding of:
  • Large Language Models (LLMs)
  • Prompt engineering
  • RAG architecture
  • 5+ years' Experience with:
  • Azure OpenAI / OpenAI APIs
  • LangChain / Semantic Kernel
  • Vector databases (Azure AI Search, Pinecone, etc.)
  • Knowledge of multi-agent orchestration patterns and tool integration.
  • 5+ years' experience in Python, SQL (mandatory)
  • Familiarity with REST APIs and SDK integrations.

Soft Skills
  • Strong analytical and problem-solving mindset.
  • Ability to translate business problems into AI-driven solutions.
  • Excellent communication and stakeholder engagement.
  • Leadership and mentoring capabilities.

Preferred Qualifications
  • Azure Certifications (AZ-305, DP-203, AI-102).
  • Experience delivering GenAI / Copilot / enterprise AI solutions.
  • Exposure to multi-cloud environments


NTT DATA provides a reasonable range of compensation for Canada-based positions. The starting pay range for this remote role is $80-$90/hour. This range reflects the minimum and maximum target compensation for the position across all Canada locations. Actual compensation will depend on a number of factors, including the candidate's actual work location, relevant experience, technical skills, and other qualifications.
This position is eligible for NTT DATA's Employee Assistance Program (EAP) and Discount Perks.

Similar Jobs

More Jobs at The Nippon Telegraph and Telephone Corporation (NTT)

More Enterprise Technology Jobs

Find similar Azure Solution/Data Architect jobs: