Distinguished AI Engineer

Compunnel

$130K — $180K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 10+ years in AI/ML systems, distributed systems, enterprise architecture, or platform engineering.
  • Deep experience with LLMs, RAG, embeddings, model serving, and AI orchestration.
  • Proven track record defining architecture and technical standards across multiple engineering teams.
  • Strong AWS cloud architecture experience or equivalent from other hyperscalers, with proficiency in cloud-agnostic AI platform design.
  • Expertise in shaping Terraform/IaC standards, DevOps pipelines, and secure deployment patterns.
  • Strong ability to influence senior stakeholders across various business and technical forums.

Responsibilities

  • Define AI architecture for AIRP, LLM platforms, model hubs, and gateways.
  • Establish enterprise AI development and operational standards.
  • Create AWS implementation patterns aligned with cloud-agnostic strategies.
  • Define Terraform module standards and observability protocols.
  • Guide architecture for secure and scalable AI inference across diverse environments.
  • Define guardrail patterns for bias monitoring and harmful content controls.
  • Lead design reviews and provide technical assurance for AI systems.

Benefits

  • Opportunity to work at the forefront of AI technology.
  • Collaborative work environment with access to diverse stakeholders.
  • Engagement with emerging AI tech and evaluation of their business value.
  • Potential to influence and set technical standards in a leading global organization.
Full Job Description
JOB SUMMARY
Distinguished AI Engineer
Enterprise AI Architecture / LLM Platforms / Advanced AI Systems
Distinguished / Principal Technical Leader

Key Responsibilities
Define architecture for AIRP, LLM platforms, model hubs, AI gateways, RAG services, agent frameworks, orchestration layers, and model-serving infrastructure.
Establish enterprise standards for AI SDLC, LLMOps, MLOps, evaluation, release management, operational resilience, and production support.
Create AWS implementation patterns aligned with a cloud-agnostic blueprint.
Define standards for Terraform modules, reusable IaC templates, environment strategy, pipeline promotion, approvals, observability, secrets, rollback, and operational controls.
Guide architecture for secure, scalable, and cost-efficient inference across cloud, hybrid, private, and containerized environments.
Define guardrail patterns for hallucination mitigation, bias monitoring, harmful-content controls, prompt injection defense, data leakage prevention, and human oversight.
Lead design reviews for critical AI systems and provide technical assurance to architecture, risk, security, and governance forums.
Partner with cybersecurity, risk, compliance, legal, audit, product, business, and citizen-development enablement teams.
Assess emerging AI technologies and recommend adoption based on business value, maturity, risk, cost, portability, and regulatory fit.

Required Qualifications
10+ years in AI/ML systems, distributed systems, enterprise architecture, or platform engineering.
Deep experience with LLMs, RAG, embeddings, model serving, AI orchestration, evaluation frameworks, and AI infrastructure.
Proven track record defining architecture and technical standards across multiple engineering teams.
Strong AWS cloud architecture experience or comparable hyperscaler depth, with clear ability to design cloud-agnostic AI platform patterns.
Experience shaping Terraform/IaC standards, DevOps pipelines, secure deployment patterns, observability, resiliency, and platform operating models.
Ability to influence senior stakeholders and operate across business, technology, risk, compliance, security, data, and architecture forums.

Preferred Qualifications
Global bank, fintech, financial-services, or regulated-enterprise platform experience.
Experience with enterprise AI platforms, private LLM deployments, internal model hubs, AI gateways, multi-cloud AI strategy, or platform blueprint ownership.
Familiarity with Responsible AI, model risk management, audit expectations, technology risk controls, and citizen development governance.

Similar Jobs

More Jobs at Compunnel

  • Cloud Architect
    $120K — $150K *
    Aliso Viejo, CA 92656 (Orange County)
    Enterprise Technology
    In-Person
  • MES Software Engineer
    $90K — $120K *
    Charlotte, NC 28269 (Mecklenburg County)
    Manufacturing & Automotive
    In-Person
  • Applied AI Researcher
    $120K — $150K *
    Jersey City, NJ 07305 (Hudson County)
    Finance & Insurance
    In-Person
  • AI Product Manager
    $120K — $150K *
    Jersey City, NJ 07305 (Hudson County)
    Finance & Insurance
    In-Person
  • Sr. Project Manager
    $100K — $130K *
    Jersey City, NJ 07305 (Hudson County)
    Finance & Insurance
    In-Person

More Enterprise Technology Jobs

Find similar Distinguished AI Engineer jobs: