Staff AI Platform & Agent Runtime Engineer

EQ Bank | Equitable Bank

$120K — $150K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7+ years in software, platform, or cloud engineering; 3+ years in AI/ML platforms or agentic AI systems
  • Deep expertise with Azure technologies including AKS, networking, and identity
  • Experience building CI/CD pipelines for ML and LLM workloads
  • Strong knowledge of distributed systems and container orchestration (Kubernetes)
  • Familiarity with agent frameworks like Semantic Kernel and LangChain
  • Understanding of LLM inference optimization and model evaluation
  • Track record of establishing platform standards for developer enablement

Responsibilities

  • Define the architecture and roadmap for enterprise AI platforms
  • Design, build, and operate AI-native CI/CD frameworks
  • Implement secure controls and governance for AI systems
  • Establish practices for reliability, observability, and FinOps
  • Lead architecture reviews and facilitate developer enablement
  • Provide technical leadership and guidance to engineering teams

Benefits

  • Work at the cutting-edge intersection of platform engineering and AI
  • Opportunity for hands-on leadership in a rapidly evolving space
  • Collaboration with teams across the organization to enhance AI adoption
  • Focus on building secure, scalable, and reliable AI platforms
  • Impact the technical direction and shape the runtime for intelligent agent workloads
Full Job Description
Purpose of the Job

We are looking for a Staff AI Platform & Agent Runtime Engineer to build the foundation for enterprise-scale AI and agent execution at EQ Bank. In this role, you will architect and operate the platform that powers our next generation of AI agents from experimentation through production, enabling teams across the organization to build, deploy, and scale intelligent agentic workloads securely and reliably.

You will sit at the intersection of platform engineering, MLOps, and agentic AI, shaping the runtime, tooling, and developer experience that accelerates AI adoption across every business domain. This is a hands-on leadership role for someone who thrives on solving hard infrastructure problems and setting the technical direction for a rapidly evolving space.

Main Activities:
• Define enterprise AI platform architecture and roadmap.
• Design, build and operate AI-native CI/CD platforms.
• Implement secure-by-design AI controls and governance.
• Define reliability, observability, resilience and FinOps practices.
• Lead architecture reviews and developer enablement programs.
• Provide technical leadership across engineering teams.

Knowledge/Skill Requirements:
• 7+ years of software, platform, or cloud engineering experience, with 3+ years in AI/ML platforms or agentic AI systems.
• Deep hands-on expertise with Azure (AKS, networking, private endpoints, identity, Key Vault) and Azure AI Foundry or equivalent AI platforms.
• Proven experience building CI/CD pipelines for ML/LLM workloads (model, prompt, and agent lifecycle management).
• Strong background in distributed systems, container orchestration (Kubernetes), and API/SDK design.
• Experience with agent frameworks (e.g., Semantic Kernel, LangChain, AutoGen) and orchestration patterns (memory, tools, planning).
• Solid understanding of LLM inference optimization, model routing, evaluation, and observability.
• Track record of establishing platform standards, paved paths, and developer enablement at scale.
• Excellent collaboration and communication skills across engineering, security, risk, and business stakeholders.

Preferred Qualifications
• Prior experience in regulated industries (financial services, banking, insurance).
• Familiarity with Microsoft Fabric, Power Platform, Copilot, and Copilot Studio integrations.
• Experience with FinOps for AI workloads including cost attribution, token accounting, and model economics.
• Background in Responsible AI, model governance, and evaluation frameworks.
• Contributions to open-source AI/agent platform projects.

Similar Jobs

More Jobs at EQ Bank | Equitable Bank

More Information Technology Jobs

Find similar Staff AI Platform & Agent Runtime Engineer jobs: