Job Summary:
An experienced AI DevOps Engineer is required to build, automate, secure, deploy, and operate the delivery foundation for enterprise Generative AI solutions and Digital Coworkers. This role operates at the intersection of DevOps, cloud platform engineering, GenAIOps, infrastructure automation, security, and production reliability. The selected professional will establish reusable pipelines and deployment patterns to migrate AI applications, agents, prompts, configurations, infrastructure, and supporting services from development to production environments. Collaboration with multidisciplinary teams will be essential to improve release speed while maintaining governance, traceability, resilience, and operational readiness in a regulated financial services environment.
Key Responsibilities:
• Design, build, and maintain CI/CD pipelines for AI applications, APIs, agents, orchestration services, infrastructure, prompts, configurations, and evaluation assets.
• Create reusable pipeline templates, quality gates, approval workflows, artifact controls, environment promotions, rollback patterns, and release evidence.
• Integrate automated testing across code quality, security, infrastructure, APIs, model and agent behavior, prompt regressions, and deployment smoke tests.
• Operationalize Generative AI applications and agents across development, test, staging, and production environments.
• Implement repeatable processes for evaluation, versioning, deployment, monitoring, optimization, rollback, and retirement of AI-enabled solutions.
• Design and maintain secure cloud infrastructure using Terraform and approved Infrastructure as Code patterns.
• Support containerized workloads and orchestration using Docker and Kubernetes platforms.
• Embed security, privacy, compliance, and risk controls into the software and AI delivery lifecycle.
• Implement end-to-end observability across infrastructure, applications, APIs, AI services, agents, and workflows using logs, metrics, traces, dashboards, and alerts.
• Mentor engineering teams on DevOps, Infrastructure as Code, secure delivery, GenAIOps, observability, and production engineering practices.
Required Qualifications:
• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related discipline, or equivalent practical experience.
• 7+ years of experience in DevOps, platform engineering, cloud engineering, site reliability engineering, software engineering, or a related discipline.
• Minimum 3 years of hands-on experience building and supporting cloud environments and production delivery pipelines.
• Proficiency in Microsoft Azure, Azure DevOps, GitHub, Terraform, Docker, Kubernetes, and Python.
• Scripting experience using Bash or PowerShell.
Preferred Qualifications:
• Experience deploying and operating Generative AI applications, LLM-powered services, AI agents, RAG solutions, vector search, or shared enterprise AI platforms.
• Knowledge of GenAIOps, MLOps, AgentOps, model and endpoint lifecycle management, prompt versioning, and AI observability.
• Experience with OpenTelemetry and enterprise observability platforms such as Azure Monitor, Application Insights, Datadog, Dynatrace, or Splunk.
• Familiarity with GitOps and deployment tooling such as Argo CD or Helm.
• Prior experience in the financial services sector or another highly regulated industry.
• Relevant certifications in cloud technologies, Kubernetes, Terraform, DevOps, or AI engineering.