Blue Cross Blue Shield of Massachusetts

Associate Director, AI Solution Architecture

Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's degree in Computer Science, Machine Learning, Data Science, or a related technical field.
  • 8+ years in software engineering or solution architecture, including 3+ years focused on large-scale AI/ML or LLM-based agentic solutions.
  • 3+ years leading teams of technical architects or systems designers.
  • Experience with Google Cloud Platform (GCP) services, such as Vertex AI and BigQuery.
  • Proven expertise in designing solution architectures using Large Language Models (LLMs).
  • Strong command of API design and integrating AI into existing systems.
  • Solid knowledge of MLOps practices for monitoring LLM production.

Responsibilities

  • Lead, mentor, and manage a team of AI solution architects.
  • Partner with AI Engineering to assess business needs and identify use cases.
  • Oversee the architectural design of AI assistants and establish best practices.
  • Guide the design of intelligent, multi-agent workflows for diverse use cases.
  • Architect secure and scalable integrations with enterprise APIs and databases.
  • Embed ethical considerations and governance into AI solutions.
  • Design solutions that ensure high availability and performance.

Benefits

  • Paid time off
  • Medical, dental, and vision insurance
  • 401(k) plan
  • Comprehensive well-being benefits
Full Job Description
Associate Director, AI Solution Architecture

We are looking for an Associate Director, AI Solution Architecture to lead our Enterprise AI and Solution Architecture group. In this leadership role, you will translate enterprise AI strategy into coherent, governed, and production-viable solution architectures that span business lines, platforms, and geographies.

This role does not build the core platform or own feature delivery; rather, you will define how AI capabilities are assembled into complete, end-to-end business solutions. Operating as a critical technical peer to the AI engineering and delivery function, you will bridge the gap between complex business needs and scalable architecture to drive the adoption of intelligent AI assistants and agentic workflows across the enterprise.
What You'll Do
  • Team Leadership & Mentorship: Lead, mentor, and manage a high-performing team of AI solution architects, providing technical guidance, architectural oversight, and career development.
  • Solution Design & Engineering Partnership: Partner with the AI Engineering team to conduct business needs assessments and identify high-impact agentic use cases. Translate complex business requirements into robust, scalable technical blueprints that enable production-grade engineering delivery.
  • Architect Agentic Solutions: Oversee the architectural design of AI assistants, establishing enterprise best practices for model selection, prompt orchestration, retrieval-augmented generation (RAG), and agent orchestration.
  • Multi-Agent Orchestration: Guide the design of intelligent, multi-step AI agents, defining patterns for sequential, loop, parallel, and hierarchical architectures to handle multi-turn, multi-domain use cases.
  • System Integration: Architect secure, scalable tool-use and function-calling patterns, ensuring AI agents connect seamlessly to enterprise APIs, databases, and third-party systems.
  • Responsible AI & Governance: Partner with AI Governance to structurally embed ethical considerations, fairness, transparency, hallucination mitigation, and strict data privacy into all AI solutions.
  • Production Scalability: Design highly available, production-grade solutions, collaborating closely with engineering leads to ensure architectural concepts translate into reliable, high-performance deployments.
  • Communication: Serve as the primary architectural liaison, effectively articulating the value, mechanics, and design of agentic AI solutions to non-technical business leaders and executive stakeholders.
Required Qualifications
  • Education: Bachelor's or Master's degree in Computer Science, Machine Learning, Data Science, or a related technical field (or equivalent practical experience).
  • Experience: 8+ years in software engineering or solution architecture, with 3+ years specifically focused on designing large-scale AI/ML or LLM-based agentic solutions.
  • Leadership: 3+ years of experience directly managing and leading teams of technical architects or systems designers.
  • Cloud Expertise: Hands-on architectural experience with Google Cloud Platform (GCP) services, including Vertex AI Agent Builder, Vertex AI Search, BigQuery, Cloud Storage, and Cloud Run.
  • AI Architecture: Proven expertise in designing solution architectures leveraging Large Language Models (LLMs), including RAG, embeddings, complex function calling, and multi-agent frameworks.
  • Integration & Systems: Strong command of API design, microservices, cloud-native development patterns, and integrating AI capabilities into existing enterprise product ecosystems.
  • MLOps Foundations: Solid knowledge of MLOps practices, including designing frameworks to measure and monitor LLM quality, latency, and cost in production.
  • Communication: Exceptional ability to translate ambiguous business problems into structured technical architectures and present them clearly to diverse audiences.
Preferred Qualifications
  • Certifications: Google Cloud Professional Cloud Architect or Professional Machine Learning Engineer.
  • Advanced AI Orchestration: Deep exposure to designing architecture for autonomous tool-use patterns and frameworks such as Google ADK, LangChain, or LlamaIndex.
  • Data Retrieval: Experience integrating and scaling enterprise vector databases (e.g., Vertex AI Vector Search, AlloyDB, Pinecone) for high-performance, embedding-based retrieval.
  • Regulated Industries: Experience working in healthcare, insurance, or finance, with a strong understanding of data privacy frameworks (e.g., HIPAA) and compliance requirements in solution design.


Minimum Education Requirements:

High school degree or equivalent required unless otherwise noted above

Location
BostonTime Type
Full time

Salary Range: $215,010.00 - $262,790.00

The job posting range is the lowest to highest salary we in good faith believe we would pay for this role at the time of this posting. We may ultimately pay more or less than the posted range, and the range may be modified in the future. An employee's pay position within the salary range will be based on several factors including, but limited to, relevant education, qualifications, certifications, experience, skills, performance, shift, travel requirements, sales or revenue-based metrics, and business or organizational needs and affordability.

This job is also eligible for variable pay.

We offer comprehensive package of benefits including paid time off, medical/dental/vision insurance, 401(k), and a suite of well-being benefits to eligible employees.

Note: No amount of pay is considered to be wages or compensation until such amount is earned, vested, and determinable. The amount and availability of any bonus, commission, or any other form of compensation that are allocable to a particular employee remains in the Company's sole discretion unless and until paid and may be modified at the Company's sole discretion, consistent with the law.

About Blue Cross Blue Shield of Massachusetts

Blue Cross Blue Shield of Massachusetts (BCBSMA) is a state licensed private health insurance company under the Blue Cross Blue Shield Association with headquarters in Boston. It is the largest health plan in Massachusetts, serving 2.8 million members. BCBSMA is committed to providing access to high-quality, affordable health care to help improve the health and well-being of its members and the communities it serves.
Learn more about Blue Cross Blue Shield of Massachusetts
Size
3,700 employees
Industry
Founded
1937

Similar Jobs

More Jobs at Blue Cross Blue Shield of Massachusetts

More Enterprise Technology Jobs

Find similar Associate Director, AI Solution Architecture jobs: