IBM

Senior AI Architect

IBM$145K — $175K *
Ohio, IL 61349In-Person
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8+ years of experience in enterprise architecture encompassing AI/ML, cloud infrastructure, and systems integration
  • Hands-on experience with designing enterprise AI solutions on Azure, including Azure OpenAI and Azure Machine Learning
  • Strong familiarity with platform engineering and infrastructure-as-code tools like Terraform and Bicep
  • Experience building observability solutions for AI/ML systems in production environments
  • Demonstrated ability to define and enforce AI governance frameworks at enterprise scale

Responsibilities

  • Architect end-to-end enterprise AI solutions integrating models and data platforms
  • Define integration patterns across AI services and core business systems
  • Translate complex requirements into scalable AI solution designs
  • Lead architecture design reviews and guide delivery teams across projects
  • Design Azure-based AI platform infrastructure for scalable deployments
  • Establish standards for infrastructure-as-code and CI/CD pipelines
  • Create observability frameworks for monitoring AI systems

Benefits

  • Comprehensive healthcare benefits including medical, dental, vision, and mental health support
  • 401(k) and cash balance pension plan, with financial counseling options
  • Generous paid time off including holidays, sick leave, vacation, and parental leave
  • Access to training and educational resources for skill growth and certifications
  • Diversity-focused employee resource groups and community volunteer opportunities
Full Job Description
Your role and responsibilities

Enterprise AI Solution Architecture
• Architect end-to-end enterprise AI solutions that integrate AI models, data platforms, and enterprise systems into cohesive, production-grade architectures
• Define integration patterns across AI services, APIs, data pipelines, and core business systems to ensure interoperability and extensibility
• Translate complex business requirements into scalable AI-powered solution designs, with clear articulation of tradeoffs, risks, and value drivers
• Lead architecture design reviews and provide hands-on guidance to delivery teams across active engagements
• Contribute to practice development by building reusable assets, frameworks, and point-of-views that strengthen our AI delivery capability

Platform Engineering & Cloud Infrastructure
• Design and implement Azure-based AI platform infrastructure that supports scalable model deployment, data ingestion, and application integration
• Define infrastructure-as-code standards and CI/CD pipeline patterns for AI workloads, enabling repeatable and auditable deployments
• Architect cloud-native environments optimized for AI throughput, cost efficiency, and operational resilience
• Establish platform engineering standards that enable development teams to build, test, and ship AI solutions faster and more reliably
• Evaluate and recommend emerging platform capabilities, cloud services, and tooling that advance our delivery approach

Observability, Governance & Development Lifecycle
• Design observability frameworks for AI systems including model monitoring, prompt evaluation, drift detection, and performance alerting
• Define AI governance standards covering responsible AI principles, audit trails, explainability requirements, and human-in-the-loop controls
• Establish development lifecycle practices for AI - from experimentation and model validation through to production deployment and ongoing operations
• Implement guardrail frameworks and safety controls for agentic and generative AI workloads to ensure appropriate oversight and auditability
• Champion MLOps and AI engineering best practices across the team, ensuring solutions are maintainable, observable, and continuously improvable

Thought Leadership & Practice Growth
• Serve as a senior technical voice both internally and with clients, sharing expertise, identifying emerging patterns, and helping define our AI point of view
• Mentor architects and engineers on platform engineering, governance, and AI architecture best practices
• Engage in pre-sales and solutioning activities, helping shape proposals and articulate our technical differentiation

This role can be performed from anywhere in the US.

Required education

Bachelor's Degree

Preferred education

Master's Degree

Required technical and professional expertise
• 8+ years of experience in enterprise architecture, with demonstrated expertise spanning AI/ML, cloud infrastructure, and systems integration
• Hands-on experience designing enterprise AI solutions on Azure, including Azure OpenAI, Azure Machine Learning, and supporting data services
• Strong grounding in platform engineering, infrastructure-as-code (e.g., Terraform, Bicep), and CI/CD pipeline design for AI workloads
• Experience building observability and monitoring solutions for AI/ML systems in production environments
• Proven ability to define and enforce AI governance, responsible AI, and compliance frameworks at enterprise scale
• Comfortable leading design conversations with both technical teams and client stakeholders

Preferred technical and professional experience
• Familiarity with agentic AI architectures, orchestration frameworks (LangChain, Semantic Kernel, AutoGen), and RAG pipeline design
• Experience with Azure data platform services including Microsoft Fabric, Azure Synapse Analytics, and Azure Data Factory
• Knowledge of MLOps practices including model versioning, A/B testing, canary deployments, and feedback loop design
• Background contributing to a consulting practice or Center of Excellence - building frameworks, POVs, and reusable assets
• Azure certifications such as Azure Solutions Architect Expert, Azure AI Engineer Associate, or DevOps Engineer Expert

OTHER RELEVANT JOB DETAILS

IBM offers a competitive and comprehensive benefits program. Eligible employees may have access to:

- Healthcare benefits including medical & prescription drug coverage, dental, vision, and mental health & well being

- Financial programs such as 401(k), cash balance pension plan, the IBM Employee Stock Purchase Plan, financial counseling, life insurance, short & long- term disability coverage, and opportunities for performance based salary incentive programs

- Generous paid time off including 12 holidays, minimum 56 hours sick time, 120 hours vacation, 12 weeks parental bonding leave in accordance with IBM Policy, and other Paid Care Leave programs. IBM also offers paid family leave benefits to eligible employees where required by applicable law

- Training and educational resources on our personalized, AI-driven learning platform where IBMers can grow skills and obtain industry-recognized certifications to achieve their career goals

- Diverse and inclusive employee resource groups, giving & volunteer opportunities, and discounts on retail products, services & experiences

This position was posted on the date cited in the key job details section and is anticipated to remain posted for 21 days from this date or less if not needed to fill the role.

IBM will not be providing visa sponsorship for this position now or in the future. Therefore, in order to be considered for this position, you must have the ability to work without a need for current or future visa sponsorship.

The compensation range and benefits for this position are based on a full-time schedule for a full calendar year. The salary will vary depending on your job-related skills, experience and location. Pay increment and frequency of pay will be in accordance with employment classification and applicable laws. For part time roles, your compensation and benefits will be adjusted to reflect your hours. Benefits may be pro-rated for those who start working during the calendar year.

About IBM

Sequent Computer Systems designs and manufactures multiprocessing computer systems based on Cache Coherent Non-Uniform Memory Access architecture, which are used primarily as application and database servers for commercial applications. Through a partnership with Oracle Corporation, Sequent became a dominant high-end UNIX platform in the late 1980s and early 1990s. Later it introduced a next-generation high-end platform for UNIX and Windows NT based on non-uniform memory access architecture, NUMA-Q. Sequent Computer Systems, Inc. was incorporated in 1983 and is based in Beaverton, Oregon. In July 1999 Sequent Computer Systems, Inc. was acquired by International Business Machines Corp.

IBM Careers

Joining IBM presents a prime opportunity to be part of our global team of professionals, leading the way in technological innovation and business solutions. At IBM, we offer more than just job opportunities; we provide a platform for growth, leadership development, and a chance to be at the forefront of industry innovation. Work You’ll Do At IBM, your work impacts global markets and helps reshape industries. As part of our team, you will contribute to projects that harness the power of cloud computing, AI, and blockchain technologies. With IBM, you are positioned to lead in the marketplace, leveraging our deep industry expertise and commitment to digital innovation. Transform Your Career IBM is not just a company; it's a culture of innovation and leadership. We are committed to diversity and providing an inclusive environment where all professionals can thrive. Joining IBM means being part of a team that values your unique skills and perspectives. IBM offers a variety of career paths, including full-time positions and internships, that allow you to explore your interests and develop new skills. Our professional development programs are designed to help you grow at every stage of your career, featuring robust training, certification support, and opportunities for advancement. Innovate with Us Engage in work that matters with a team of over 350,000 IBMers worldwide, driving progress in over 170 countries. At IBM, innovation isn’t just about technology, it’s about transforming how businesses operate and compete. Your work will deliver solutions that anticipate and fulfill the needs of our clients in an ever-evolving landscape. Be Part of a Great Team IBMers are diverse, talented, and globally connected. You’ll collaborate with thought leaders and industry experts who are shaping the future of technology. Our culture fosters creativity, teamwork, and the continuous pursuit of excellence. Networking and Professional Growth IBM is deeply invested in the professional growth of its employees. We encourage networking within the company to foster connections that can lead to greater innovation and career advancement. Our leadership is committed to providing every employee with the tools they need to succeed, from mentorship programs to diversity training. Explore Job Opportunities Whether you’re looking for an internship, a graduate role, or a leadership position, IBM offers a range of career opportunities. Our hiring process is designed to be transparent and fair, providing you with all the resources you need to succeed in your interview and resume preparation. Stay Connected Join Our Team Discover the various positions available that match your skills and interests. At IBM, we look for passionate, curious, and solution-driven team players. Explore our open positions and find where you can make a difference. Keep Up to Date Stay informed with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work here. Job Alert Emails Customize your subscription to receive job alerts, the latest news, and insider tips tailored to your preferences. See what exciting and rewarding opportunities await at IBM. Join IBM and be part of a legacy of leadership and innovation. Shape your future and build a career designed to last.
Learn more about IBM
Size
307,600 employees
Market Cap
$128 billion
Industry
Net Income
$5.5 billion
Founded
1911
5 Year Trend
-6.4%
Revenue
$73.6 billion
NASDAQ

Similar Jobs

More Jobs at IBM

More Enterprise Technology Jobs

Find similar Senior AI Architect jobs: