Red Hat

Architect, AI Platform

Red Hat$142K — $234K *
US-AnywhereRemote in New York, US
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8-10 years in technology roles such as sales, consulting, or development.
  • 5+ years of experience with Public Cloud and Linux technologies.
  • 3+ years of experience with Red Hat OpenShift Container Platform or Kubernetes.
  • 3+ years in production-ready AI solutions.
  • 3+ years in production-ready Machine Learning use cases.

Responsibilities

  • Design solutions leveraging the Red Hat ecosystem to solve complex business problems.
  • Collaborate closely with customers to improve AI/MLOps processes and operational efficiency.
  • Manage project scope and architectural risks to meet delivery timelines.
  • Engage in consulting sales to identify customer needs and propose technical solutions.
  • Document architectural blueprints and best practices for long-term success.
  • Commit to ongoing training in LLM, MLOps, and Cloud-Native technologies.
  • Build production-grade MLOps pipelines on Red Hat OpenShift.

Benefits

  • Comprehensive medical, dental, and vision coverage
  • Flexible Spending Account for healthcare and dependent care
  • Health Savings Account for high-deductible medical plans
  • 401(k) retirement plan with employer match
  • Generous paid time off and holidays
  • Paid parental leave for new parents
  • Disability and paid medical leave benefits
  • Employee stock purchase plan and tuition reimbursement
Full Job Description
We are seeking a visionary Red Hat Architect specializing in Machine Learning Operations (MLOps) and Artificial Intelligence (AI) to design, build, and scale our enterprise AI platform. In this role, you will bridge the gap between enterprise-grade infrastructure and cutting-edge artificial intelligence.

You will lead the architectural design of our container-native machine learning pipelines on Red Hat OpenShift, with a heavy focus on Large Language Models (LLMs), containerized model serving, scalable runtime environments, and automated benchmarking.

What you will do:
  • Design and advocate solutions that leverage the full Red Hat ecosystem to solve complex business problems, explicitly aligning AI/ML capabilities with customer strategic goals.
  • Work hand-in-hand with customer associates and executive stakeholders to guide the adoption of Artificial Intelligence and MLOps processes, drastically improving model time-to-market and operational efficiency.
  • Collaborate with project and customer team members to manage scope, mitigate architectural risks, and consistently meet delivery timelines and project goals.
  • Participate in consulting sales motions to discover customer pain points, scope complex engineering engagements, architect high-level proposals, and deliver compelling technical demonstrations/proof-of-concepts (PoCs).
  • Contribute heavily to project documentation and diagrams, capturing architectural blueprints, deployment guides, and best practices to ensure long-term customer success and internal knowledge reuse.
  • Commit to continuous training and professional development to stay at the absolute forefront of the rapidly evolving LLM, MLOps, and Cloud-Native ecosystem.
  • Architect and build production-grade MLOps pipelines using Red Hat OpenShift Container Platform and Red Hat OpenShift AI (RHOAI).
  • Guide customers through Model Selection (e.g., Llama, Mistral, Granite) by analyzing specific business use cases against hardware/GPU memory constraints, cost profiles, and licensing models.
  • Design containerized Model Deployment architectures using KServe, optimizing low-latency Inference Servers (e.g., vLLM, TGI, Triton) within OpenShift environments.
  • Establish automated Benchmarking and Test pipelines to measure tokens-per-second throughput, hardware efficiency, and cost-per-inference metrics.
  • Mentor and share knowledge with customers through structured workshops, paired programming sessions, and architectural reviews, empowering their internal teams to confidently manage the platform post-delivery.
  • Act as an internal champion, coaching junior consultants and engineering associates on the nuances of deploying AI workloads on Kubernetes.


What you will bring:
  • 8-10 years in a related technology position, e.g., sales, consulting, operations, development, etc
  • 5+ years of experience with Public Cloud and Linux technologies
  • 3+ years of experience with Red Hat OpenShift Container Platform or Kubernetes
  • 3+ years experience in production ready AI solutions.
  • 3+ years experience in production ready Machine Learning use cases.


Nice to have:
  • Experience in designing and delivering implementations using various public and private cloud infrastructure technologies and providers
  • Red Hat Certified Architect (RHCA) or Specialist certifications in OpenShift.
  • Demonstrated experience publishing technical whitepapers, architectural blueprints, or speaking at industry conferences (e.g., Red Hat Summit, KubeCon).
  • Experience in Financial Services


The salary range for this position is $142,370.00 - $234,770.00. Actual offer will be based on your qualifications.

Pay Transparency

Red Hat determines compensation based on several factors including but not limited to job location, experience, applicable skills and training, external market value, and internal pay equity. Annual salary is one component of Red Hat's compensation package. This position may also be eligible for bonus, commission, and/or equity. For positions with Remote-US locations, the actual salary range for the position may differ based on location but will be commensurate with job duties and relevant work experience.

Benefits
• Comprehensive medical, dental, and vision coverage
• Flexible Spending Account - healthcare and dependent care
• Health Savings Account - high deductible medical plan
• Retirement 401(k) with employer match
• Paid time off and holidays
• Paid parental leave plans for all new parents
• Leave benefits including disability, paid family medical leave, and paid military leave
• Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!

Note: These benefits are only applicable to full time, permanent associates at Red Hat located in the United States.

About Red Hat

Red Hat, Inc. is a leading provider of open source software solutions, including Linux, Kubernetes, and Ansible. The company was founded in 1993 and is headquartered in Raleigh, North Carolina. Red Hat operates in over 100 countries and has more than 13,000 employees worldwide. The company is committed to open source innovation and has a strong community of developers and partners. Red Hat was acquired by IBM in 2019 and is now part of IBM's Hybrid Cloud division.
Learn more about Red Hat
Size
13,000 employees
Industry
Founded
1993

Similar Jobs

More Jobs at Red Hat

More Enterprise Technology Jobs

Find similar Architect, AI Platform jobs: