Sr. Applied AI Architect

CAI

• $200K — $250K *
US-AnywhereRemote in Pennsylvania, US
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8-10+ years in applied AI, enterprise software architecture, or AI/ML engineering with 3+ years in a senior role
  • Proven experience in designing and delivering production-grade AI solutions end-to-end
  • Deep expertise in large language models, agentic AI frameworks, and orchestration architectures
  • Hands-on with enterprise AI platforms like Anthropic Claude, OpenAI, and Databricks
  • Strong skills in system design, integration architecture, and cloud infrastructure
  • Credibility in technical and executive conversations
  • Experience in regulated environments like FedRAMP, GovRAMP, or NIST compliance

Responsibilities

  • Lead the design of agentic AI systems and multi-model workflows
  • Own decisions on AI tooling between build or buy across use cases
  • Create reusable architectural patterns and technical playbooks
  • Drive technical POC development towards client-ready outcomes
  • Serve as a credible technical lead in AI solution discussions
  • Collaborate to assess and execute AI strategies
  • Evaluate AI feasibility against assessments and roadmaps

Benefits

  • Flexible remote work environment
  • Opportunities for mentorship and development within junior AI team
  • Engagement in high-impact AI initiatives across various sectors
  • Involvement in building reusable architectural assets and frameworks
  • Participation in shaping AI strategy with senior leadership and clients
Full Job Description
Sr. Applied AI Architect

Req number:

R8010

Employment type:

Full time

Worksite flexibility:

Remote

Job Summary

CAI is hiring a Sr. Applied AI Architect to serve as the primary technical engine behind our applied AI delivery across all four strategic motions. This is a builder’s role at the intersection of deep technical execution and strategic advisory

Job Description

We are seeking a highly skilled and experienced Sr. Applied AI Architect to join our IT team. This position will be full-time, remote, and is a salaried position.

What You'll Do

  • Lead technical design for agentic AI systems, LLM integrations, MCP-based orchestration, and multi-model workflows in internal and external delivery environments

  • Own build-vs-buy decisions for AI tooling across use cases, working with the CTO organization and design partners

  • Develop reusable architectural patterns, integration blueprints, and technical playbooks that scale across CAI’s delivery organization

  • Drive technical POC development from internal initiatives through to client-ready case studies, architecture and implementation

  • Serve as the technical lead and credibility anchor for AI solution conversations with executives, clients, and procurement stakeholders

  • Work alongside functional and motion owners to determine whether and how AI applies, then own the technical approach and execution

  • Pressure-test AI feasibility on CTO assessments, POC scoping, and motion-level AI roadmaps

  • Mentor and develop junior AI technical staff; contribute to the Applied AI Delivery Team model

  • Maintain deep, working knowledge of the enterprise AI landscape: LLMs (Anthropic Claude, OpenAI, Gemini), agentic frameworks, MCP architecture, Databricks, vector databases, and emerging tools

  • Apply hands-on fluency across the full stack CAI deploys; AI/ML frameworks, integration patterns, API design, cloud platforms (AWS, Azure), and security controls relevant to commercial and public sector public sector

  • Ensure architectural choices align with CAI’s governance standards, NIST AI framework, GovRAMP requirements, and client-specific compliance environments

  • Bring an evidence-based perspective on AI capability and limitations to keep initiatives grounded, realistic, and defensible.

  • Package internal AI delivery results into reusable inputs for client-ready case studies, RFP content, and competitive positioning. Build the technical artifacts that move work forward: solution designs, architecture diagrams, integration specs, feasibility assessments, and deployment guides

What You'll Need

Required:

  • 8-10+ years of experience in applied AI, enterprise software architecture, or AI/ML engineering with at least 3 years in a senior or lead role

  • Demonstrated track record of designing and delivering production-grade AI solutions end-to-end; hands-on, not advisory

  • Deep fluency with large language models, agentic AI frameworks, prompt engineering, and MCP or similar orchestration architectures

  • Hands-on experience with enterprise AI platforms: Anthropic Claude, OpenAI, Databricks, Azure AI / OpenAI Service, AWS Bedrock, or equivalent

  • Strong system design and integration architecture skills: APIs, data pipelines, event-driven systems, and cloud infrastructure

  • Ability to operate credibly across technical depth (code environments, architecture review) and executive conversation

  • Experience working in regulated or government-adjacent environments, with familiarity with FedRAMP, GovRAMP, NIST, or SOC 2 compliance requirements

  • Strong communication skills: able to translate complex technical architecture into executive-ready artifacts and client-facing narratives

  • Bachelor's degree in computer science, Engineering, or a related technical field required; master's or advanced degree preferred; or a related field required; or the equivalent combination of education, technical certifications or training, or work experience

Preferred:

  • Experience delivering AI solutions in state and local government, public sector managed services, or workforce services environments

  • Hands-on experience with Anthropic’s Model Context Protocol (MCP) and multi-agent orchestration frameworks (LangChain, AutoGen, CrewAI, or equivalent)

  • Track record of building reusable AI architectural assets, patterns, blueprints, frameworks, that scale beyond a single engagement

  • Experience contributing to AI governance frameworks, responsible AI posture, or client-facing compliance advisory

  • Certifications in relevant platforms (AWS, Azure, Databricks, Google Cloud AI) or AI governance frameworks (ISACA, NIST AI RMF)

  • Prior experience in a professional services or consulting delivery model with multiple concurrent client engagements.

Physical Demands

  • Ability to safely and successfully perform the essential job functions consistent with the ADA and other federal, state, and local standards

  • Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc

  • Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard, and monitor

$200,000 - $250,000 per year

The pay range for this position is listed above.Exact compensation may vary based on several factors, including location, experience, and education. Benefit packages include medical, dental, and vision insurance, as well as 401k retirement account access. Employees in this role receive paid time off and may also be entitled to paid sick leave and/or other paid time off as provided by applicable law.

Similar Jobs

More Jobs at CAI

More Information Technology Jobs

Find similar Sr. Applied AI Architect jobs: