IBM

Senior AI Solution Architect

IBM$145K — $175K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8+ years in enterprise or solution architecture; 3+ years focused on AI/ML solutions
  • Deep expertise in Azure AI services such as Azure OpenAI and Azure Machine Learning
  • Proven ability to define and govern enterprise-scale AI architectures
  • Strong knowledge of enterprise data platforms and cloud-native design
  • Experience in client-facing consulting roles with stakeholder engagement
  • Excellent communication skills for leading design sessions

Responsibilities

  • Set architectural vision and direction for AI engagements
  • Lead architecture design workshops with client stakeholders
  • Serve as a trusted advisor on Azure AI capabilities and technology roadmaps
  • Define and govern comprehensive Azure AI architectures
  • Embed responsible AI practices and data governance into architectural decisions
  • Engage directly and continuously with client stakeholders
  • Collaborate across teams for end-to-end delivery and manage technical risks

Benefits

  • Healthcare benefits including medical, dental, vision, and mental health
  • Financial programs like 401(k), life insurance, and performance-based incentives
  • Generous paid time off including holidays, vacation, and parental leave
  • Training resources for skills growth and industry-recognized certifications
  • Access to diverse employee resource groups and volunteer opportunities
Full Job Description
Your role and responsibilities

Thought Leadership & Technical Direction
• Set the architectural vision and direction for AI engagements, establishing design standards and reusable patterns that elevate the quality and speed of delivery
• Lead architecture design workshops and strategy sessions with client stakeholders, including executive and technical audiences
• Serve as a trusted advisor to clients on Azure AI capabilities, use case prioritization, and technology roadmap development
• Mentor delivery team members and contribute to practice development through knowledge sharing and asset creation

End-to-End Azure AI Architecture
• Define and govern complete Azure AI architectures spanning Azure OpenAI Service, Azure Machine Learning, and enterprise data platforms
• Design solutions that are scalable, secure, cost-optimized, and aligned to enterprise architecture standards from inception
• Map AI use cases to measurable business value, ensuring that prioritization decisions are grounded in ROI and strategic fit
• Develop reference architectures, integration patterns, and technical blueprints that accelerate delivery across the engagement

Governance, Security & Enterprise Standards
• Embed responsible AI practices, data governance, and compliance requirements into every architectural decision
• Define guardrails, monitoring standards, and audit frameworks to ensure AI solutions are observable, trustworthy, and maintainable at scale
• Ensure alignment with enterprise security posture including identity, access management, data residency, and regulatory requirements
• Establish operating model standards for AI deployment, support, and lifecycle management across the platform

Client Engagement & Delivery
• Engage directly and continuously with client stakeholders, translating complex technical architecture into clear business terms
• Collaborate across data engineering, application, and business teams to drive seamless end-to-end delivery
• Identify and manage technical risks proactively, surfacing tradeoffs and recommended mitigations clearly and early

This job can be performed from anywhere in the U.S.

Required education

Bachelor's Degree

Preferred education

Master's Degree

Required technical and professional expertise

Required Skills & Experience
• 8+ years of experience in enterprise or solution architecture, with 3+ years focused on AI/ML solutions
• Deep, hands-on expertise with Azure AI services including Azure OpenAI Service, Azure Machine Learning, and Azure AI Studio
• Proven track record defining and governing end-to-end AI architectures at enterprise scale
• Strong grounding in enterprise data platforms, cloud-native design principles, and integration architecture
• Experience in a client-facing consulting or professional services environment with direct executive stakeholder engagement
• Excellent communication and facilitation skills - able to lead design sessions and present recommendations with confidence

Preferred technical and professional experience

Preferred Skills
• Experience with agentic AI frameworks (LangChain, AutoGen, Semantic Kernel) and RAG pipeline design
• Familiarity with Azure data services including Microsoft Fabric, Azure Synapse Analytics, and Azure Data Factory
• Knowledge of AI governance frameworks, responsible AI principles, and enterprise risk management practices
• Azure certifications such as Azure Solutions Architect Expert or Azure AI Engineer Associate

OTHER RELEVANT JOB DETAILS

IBM offers a competitive and comprehensive benefits program. Eligible employees may have access to:

- Healthcare benefits including medical & prescription drug coverage, dental, vision, and mental health & well being

- Financial programs such as 401(k), cash balance pension plan, the IBM Employee Stock Purchase Plan, financial counseling, life insurance, short & long- term disability coverage, and opportunities for performance based salary incentive programs

- Generous paid time off including 12 holidays, minimum 56 hours sick time, 120 hours vacation, 12 weeks parental bonding leave in accordance with IBM Policy, and other Paid Care Leave programs. IBM also offers paid family leave benefits to eligible employees where required by applicable law

- Training and educational resources on our personalized, AI-driven learning platform where IBMers can grow skills and obtain industry-recognized certifications to achieve their career goals

- Diverse and inclusive employee resource groups, giving & volunteer opportunities, and discounts on retail products, services & experiences

This position was posted on the date cited in the key job details section and is anticipated to remain posted for 21 days from this date or less if not needed to fill the role.

IBM will not be providing visa sponsorship for this position now or in the future. Therefore, in order to be considered for this position, you must have the ability to work without a need for current or future visa sponsorship.

The compensation range and benefits for this position are based on a full-time schedule for a full calendar year. The salary will vary depending on your job-related skills, experience and location. Pay increment and frequency of pay will be in accordance with employment classification and applicable laws. For part time roles, your compensation and benefits will be adjusted to reflect your hours. Benefits may be pro-rated for those who start working during the calendar year.

About IBM

Sequent Computer Systems designs and manufactures multiprocessing computer systems based on Cache Coherent Non-Uniform Memory Access architecture, which are used primarily as application and database servers for commercial applications. Through a partnership with Oracle Corporation, Sequent became a dominant high-end UNIX platform in the late 1980s and early 1990s. Later it introduced a next-generation high-end platform for UNIX and Windows NT based on non-uniform memory access architecture, NUMA-Q. Sequent Computer Systems, Inc. was incorporated in 1983 and is based in Beaverton, Oregon. In July 1999 Sequent Computer Systems, Inc. was acquired by International Business Machines Corp.

IBM Careers

Joining IBM presents a prime opportunity to be part of our global team of professionals, leading the way in technological innovation and business solutions. At IBM, we offer more than just job opportunities; we provide a platform for growth, leadership development, and a chance to be at the forefront of industry innovation. Work You’ll Do At IBM, your work impacts global markets and helps reshape industries. As part of our team, you will contribute to projects that harness the power of cloud computing, AI, and blockchain technologies. With IBM, you are positioned to lead in the marketplace, leveraging our deep industry expertise and commitment to digital innovation. Transform Your Career IBM is not just a company; it's a culture of innovation and leadership. We are committed to diversity and providing an inclusive environment where all professionals can thrive. Joining IBM means being part of a team that values your unique skills and perspectives. IBM offers a variety of career paths, including full-time positions and internships, that allow you to explore your interests and develop new skills. Our professional development programs are designed to help you grow at every stage of your career, featuring robust training, certification support, and opportunities for advancement. Innovate with Us Engage in work that matters with a team of over 350,000 IBMers worldwide, driving progress in over 170 countries. At IBM, innovation isn’t just about technology, it’s about transforming how businesses operate and compete. Your work will deliver solutions that anticipate and fulfill the needs of our clients in an ever-evolving landscape. Be Part of a Great Team IBMers are diverse, talented, and globally connected. You’ll collaborate with thought leaders and industry experts who are shaping the future of technology. Our culture fosters creativity, teamwork, and the continuous pursuit of excellence. Networking and Professional Growth IBM is deeply invested in the professional growth of its employees. We encourage networking within the company to foster connections that can lead to greater innovation and career advancement. Our leadership is committed to providing every employee with the tools they need to succeed, from mentorship programs to diversity training. Explore Job Opportunities Whether you’re looking for an internship, a graduate role, or a leadership position, IBM offers a range of career opportunities. Our hiring process is designed to be transparent and fair, providing you with all the resources you need to succeed in your interview and resume preparation. Stay Connected Join Our Team Discover the various positions available that match your skills and interests. At IBM, we look for passionate, curious, and solution-driven team players. Explore our open positions and find where you can make a difference. Keep Up to Date Stay informed with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work here. Job Alert Emails Customize your subscription to receive job alerts, the latest news, and insider tips tailored to your preferences. See what exciting and rewarding opportunities await at IBM. Join IBM and be part of a legacy of leadership and innovation. Shape your future and build a career designed to last.
Learn more about IBM
Size
307,600 employees
Market Cap
$128 billion
Industry
Net Income
$5.5 billion
Founded
1911
5 Year Trend
-6.4%
Revenue
$73.6 billion
NASDAQ

Similar Jobs

More Jobs at IBM

More Information Technology Jobs

Find similar Senior AI Solution Architect jobs: