AI Platform Director

Compunnel

$130K — $180K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 6+ years of hands-on software engineering experience, mainly with Python (FastAPI, Flask).
  • Deep expertise in designing and managing Kubernetes/OpenShift workloads with GitOps.
  • At least 3 years of experience developing GenAI and LLM applications, focusing on orchestration and evaluation workflows.
  • Strong grasp of microservices, RESTful API design, and high-performance computing.
  • Foundation in data engineering, familiarity with SQL/NoSQL, Kafka, and state management.
  • Proficient in DevOps practices, CI/CD processes, and observability tools.
  • Knowledge of secure design principles, including OAuth2 and enterprise security controls.

Responsibilities

  • Design and build an enterprise-scale AI development and evaluation platform.
  • Create self-service tooling, SDKs, and APIs for efficient GenAI application deployment.
  • Develop reusable and scalable components for GenAI, including orchestration and evaluation systems.
  • Lead container-native GenAI workload implementation on Kubernetes/OpenShift.
  • Integrate and operate components of the GenAI ecosystem, such as LLMs and vector databases.
  • Drive architecture and design decisions focusing on security, scalability, and reliability.
  • Establish best practices for GenAI evaluations and production operations.

Benefits

  • Work in a cutting-edge technology environment with a focus on innovative solutions.
  • Collaborate with engineers and data scientists, fostering a team-oriented culture.
  • Opportunity to influence enterprise adoption of GenAI technologies and practices.
  • Engage with a diverse array of technologies within the AI and GenAI domains.
  • Potential for career advancement in a leadership role within AI platform engineering.
Full Job Description
JOB SUMMARY
AI Platform Engineering role at Director level, responsible for providing specialist GenAI and expertise that drive decision-making and business insights during GenAI development as well as uplifting platform features by introducing cutting edge technology capabilities, enhancements and innovative solutions.

Key Responsibilities
Design and build a firmwide AI development and evaluation platform with a strong focus on enterprise-scale GenAI benchmarking, assurance, and governance.
Develop self-service tooling, SDKs, and APIs to enable teams to build, evaluate, and deploy GenAI applications efficiently and safely.
Build reusable, scalable platform components for GenAI and agentic systems, including orchestration, evaluation pipelines, and model lifecycle workflows.
Lead the implementation of container-native GenAI workloads on Kubernetes / OpenShift using GitOps-driven deployment patterns.
Integrate and operate GenAI ecosystem components including LLMs, vector databases, embeddings, and agent frameworks.
Drive key architecture, product, and design decisions across security, authentication, observability, scalability, and reliability.
Establish platform best practices for GenAI evaluations, agentic systems, ModelOps / LLMOps, and production operations.
Collaborate closely with engineers, data scientists, security, and product teams to accelerate safe enterprise adoption of GenAI.

Required Qualifications
6+ years of strong hands-on software engineering experience, preferably in Python (FastAPI, Flask), building large-scale, cloud-native platforms.
Deep experience designing and operating Kubernetes / OpenShift workloads using Helm, Customize, container registries, and GitOps practices.
3+ years of experience building GenAI and LLM-based applications, including agentic orchestration, embeddings, evaluation workflows, and fine-tuning.
Strong understanding of microservices, RESTful API design, asynchronous and concurrent programming, and performance-oriented systems.
Solid foundation in data engineering principles including SQL/NoSQL stores, Kafka, Redis, vector databases, and state management at scale.
Proficiency in DevOps, CI/CD, observability (OpenTelemetry, Prometheus, Grafana), and SRE-inspired operational practices.
Strong working knowledge of security-first design, OAuth2, secure coding practices, and enterprise-grade platform controls.

Preferred Qualifications
Experience with agent-based frameworks or orchestration systems
Exposure to LLMOps / ModelOps / evaluation platforms
Experience working in enterprise-scale platforms or internal developer platforms

Similar Jobs

More Jobs at Compunnel

  • .Net AI Developer
    $90K — $130K *
    Charlotte, NC 28269 (Mecklenburg County)
    Information Technology
    In-Person
  • Data Engineer
    $90K — $120K *
    Mississauga, ON L4T 0A1
    Information Technology
    In-Person
  • AI Platform Director
    $130K — $180K *
    Montreal, QC H1A 0A1
    Enterprise Technology
    In-Person
  • Power BI Developer
    $90K — $130K *
    New York, NY 10025 (New York County)
    Information Technology
    In-Person
  • Full Stack Java Developer with AI
    $100K — $130K *
    East Pittsburgh, PA 15112 (Allegheny County)
    Information Technology
    In-Person

More Enterprise Technology Jobs

Find similar AI Platform Director jobs: