Sr. Director of AI Infrastructure

ARMRA Colostrum

$150K — $200K *
US-AnywhereRemote in United States
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8-12+ years in infrastructure engineering or solutions architecture, particularly in CPG or omnichannel retail
  • Strong hands-on experience with AWS, focusing on production API services
  • Deep knowledge of REST APIs, webhooks, and data pipeline architecture
  • Experience managing LLM-powered systems in production
  • Familiarity with data governance and privacy compliance, including CCPA and GDPR
  • Strong leadership skills for cross-departmental technical initiatives
  • Ability to communicate complex technical concepts to both business and technical stakeholders
  • Proficient in documentation practices and comfortable in fast-paced remote work environments

Responsibilities

  • Own and enhance integration architecture for ARMRA's core platforms
  • Build and manage middleware and API integrations for AI functionality
  • Evaluate and upgrade centralized data architecture for real-time business intelligence
  • Establish standards for API security and system performance
  • Maintain pipeline reliability and address issues as they arise
  • Architect and optimize AWS environments for the AI ecosystem
  • Manage deployment of production AI systems with effective monitoring and guardrails
  • Ensure compliance with privacy policies and regulatory requirements

Benefits

  • Full-time remote position
  • Monday-Friday schedule, 9 am - 6 pm EST
  • Opportunity to lead critical AI initiatives across a diverse range of business functions
  • High visibility role with cross-departmental impact
  • Possibility for career progression to Senior Director level for qualified candidates
Full Job Description
Job Title: Senior Director of AI Infrastructure

Job Type: Full-Time (Remote)

ARMRA Schedule: Monday-Friday, 9 am - 6 pm EST

The Role: ARMRA is seeking a Sr. Director of AI Infrastructure to own, build, and scale the foundational AI infrastructure across the entire organization. As ARMRA's dedicated AI leader, you will be the single owner of technical standards, governance, and the scalable architecture that connects all of ARMRA's business systems into a unified intelligent automation layer - partnering cross-functionally with the Director of IT as needed to ensure alignment across the broader technology ecosystem.

This is a critical, high-visibility, company-wide role. ARMRA has established a strong foundational infrastructure connecting platforms across customer experience, e-commerce, retail, marketing, finance, and operations. You will inherit that foundation and take full ownership of it - driving improvements, closing gaps, implementing new capabilities, and expanding the infrastructure as the business evolves - while enabling AI agents to take real action on real data in real time.

This role is the definitive bridge between leadership's strategic vision and the enterprise-grade execution required to sustain and advance a company-wide AI backbone. You will own and continuously develop a uniform, resilient, and high-performance AI playbook that serves every function of the business equally - from Retail and Operations to Marketing, Finance, and Customer Experience.

The right person for this role has built, owned, and scaled production integration systems end-to-end. You understand that the best AI architecture is not about training models - it's about connecting systems, enforcing governance, and making intelligent automation reliable enough to trust across every surface of the business. Whether you come in at the Director or Senior Director level, you bring deep technical ownership, sound strategic judgment, and the ability to move with urgency in a fast-paced environment..

Responsibilities:

Integration Architecture & Data Foundations
  • Own and continuously develop the integration architecture connecting ARMRA's core business platforms across e-commerce, retail, marketing, finance, operations, and customer experience into unified, queryable data flows.
  • Build, maintain, and extend middleware and API integrations that enable AI agents to perform real actions across business functions: modifying orders, managing subscriptions, surfacing inventory, pulling financial data, and automating operational workflows - all gated to appropriate system states with hard fail safeguards.
  • Assess, enhance, and expand the existing centralized data architecture to ensure it remains optimized for real-time inference, business intelligence, unified reporting, and AI-driven decision-making as business needs evolve.
  • Establish and enforce enterprise-wide standards for API security, latency, and throughput across all integrated systems.
  • Own pipeline reliability, monitoring, and documentation. When something breaks, you fix it. When something's fragile, you rebuild it.
  • Evaluate and recommend new tools, connectors, and platforms based on API capability, data governance requirements, and integration feasibility.

Cloud Infrastructure & Production AI Systems
  • Architect, deploy, and optimize AWS cloud environments for performance, reliability, cost efficiency, and scalability across the full AI ecosystem.
  • Deploy and manage production AI systems - primarily LLM API integrations, workflow automation, and agentic AI agents - with appropriate monitoring, guardrails, and escalation paths.
  • Build and extend agentic AI systems that execute multi-step tasks autonomously across departments with clear boundaries and human handoff protocols.
  • Own prompt architecture at the infrastructure level: API configuration, system prompt management, version control, and testing frameworks for production AI workflows.
  • Drive optimization of cloud computing resources and API usage across the entire AI ecosystem to ensure cost efficiency, elasticity, and scalability.

Data Governance & Compliance
  • Ensure all AI implementations and data integrations comply with ARMRA's privacy policy, data security SOPs, and regulatory requirements (CCPA/CPRA, GDPR where applicable).
  • Enforce data sovereignty across the enterprise: ARMRA's customer and business data stays on ARMRA's infrastructure. No PII traverses third-party rails without explicit governance approval.
  • Maintain and update the subprocessor inventory as new tools and integrations come online.
  • Partner with Legal and Compliance on AI-specific governance: customer disclosure requirements, model training prohibitions, vendor data protection standards, and PII handling protocols.
  • Own the technical side of data retention enforcement, deletion workflows, and audit trails across integrated systems.
  • Build and evolve the AI governance framework in partnership with Compliance, including approved tool lists, subprocessor documentation, and model training restrictions.

Cross-Functional Technical Leadership
  • Serve as the primary technical consultant for department heads and executive leadership on AI architecture, investment trade-offs, and long-term capability planning.
  • Partner with leaders across all departments - Operations, Marketing, Finance, Retail, and Customer Experience - to identify high-impact automation opportunities and translate business needs into technical requirements.
  • Collaborate closely with the Director of IT to ensure AI infrastructure decisions are aligned with the broader technology ecosystem and organizational standards.
  • Run discovery sessions with stakeholders to map current workflows, quantify manual effort, and prioritize builds based on ROI and feasibility.
  • Build and maintain dashboards and reporting infrastructure that give leadership visibility into AI performance, automation coverage, and operational efficiency gains across the business.
  • Stay current on emerging AI tools, APIs, and integration patterns. Bring recommendations with a plan, not just awareness. If something can make us faster, flag it with a build timeline.

Skills & Qualifications:
  • 8-12+ years in infrastructure engineering, solutions architecture, or a principal/lead technical role, with direct experience building and scaling enterprise-scale integration systems in CPG, consumer brands, or omnichannel retail environments. Candidates with deeper experience will be considered for the Senior Director level.
  • Strong hands-on experience with AWS (required). Experience architecting and managing cloud-native environments for production API services, not just dev/test workloads.
  • Deep experience with REST APIs, webhooks, middleware design, and data pipeline architecture. You've connected messy real-world business systems across multiple departments, not just built demos.
  • Direct experience deploying and managing LLM-powered systems in production (API integrations, prompt management, agentic workflows). You don't need to train models - you need to make them work reliably at scale.
  • Experience building and maintaining business intelligence infrastructure: data warehousing, unified reporting, and cross-departmental analytics.
  • Strong understanding of data governance, privacy compliance (CCPA, GDPR), and security best practices for handling customer PII across integrated systems.
  • Exceptional ability to lead complex technical initiatives with cross-departmental impact, requiring alignment from multiple executive stakeholders.
  • Ability to translate between business stakeholders and technical execution. You can sit in a room with a VP and a developer and make sure both walk out aligned.
  • Strong documentation habits. If you build it, you document it. If you change it, you update the docs.
  • Comfortable working autonomously in a fast-paced, remote environment where priorities shift and you're expected to move without waiting for permission.
  • Bias toward building and shipping over planning and presenting. We need someone who gets things into production, not someone who makes great slide decks about what could be.

Nice to Have:
  • Hands-on experience with LLM APIs and building agentic AI systems in production.
  • Background in CX platforms, e-commerce infrastructure, or retail technology systems.
  • Experience with containerization (Docker) and orchestration for deploying AI microservices.
  • Familiarity with emerging AI integration standards and protocols.
  • Experience with data warehousing platforms and modern ETL/ELT tools.
  • Prior experience building internal tools or dashboards for non-technical users.

Similar Jobs

  • Idaho National Laboratory
    IT Architect
    $114K — $234K *
    Idaho National Laboratory
    Idaho Falls, ID 83401 (Bonneville County)
  • Advanced Micro Devices, Inc
    Principal AI Software Engineer
    $150K — $200K *
    Advanced Micro Devices, Inc
    San Jose, CA 95123 (Santa Clara County)
  • AI Architect (USA)
    $120K — $150K *
    Ascendix Technologies
    Dallas, TX 75217 (Dallas County)
  • NTT DATA  Services
    AI Solution Architect
    $120K — $150K *
    NTT DATA Services
    Plano, TX 75025 (Collin County)
  • Virtusa Corporation
    AI Architect
    $130K — $180K *
    Virtusa Corporation
    New York, NY 10025 (New York County)
  • Wipro
    AI Strategist - Partner
    $190K — $265K *
    Wipro
    Atlanta, GA 30349 (Fulton County)

More Jobs at ARMRA Colostrum

More Information Technology Jobs

Find similar Sr. Director of AI Infrastructure jobs: