Gen AI Infrastructure Engineer

Bessemer Trust Company

$160K — $200K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7+ years in DevOps, platform, or cloud infrastructure engineering.
  • Strong AWS expertise with services like IAM, CloudFormation, and Lambda.
  • Hands-on experience with AWS CDK or strong familiarity with CloudFormation/Terraform.
  • Experience with CI/CD tools like Bitbucket Pipelines or GitHub Actions.
  • Solid understanding of IAM security practices.
  • Familiarity with containers and ECR for deployment workflows.
  • Experience managing at least one production database.

Responsibilities

  • Deploy GenAI components in a secure and repeatable manner while troubleshooting issues.
  • Construct and enhance CI/CD pipelines and infrastructure code.
  • Oversee AWS environments for GenAI, ensuring security and proper management of resources.
  • Develop secure deployment architecture for shared GenAI infrastructure.
  • Support AI agent data stores, managing provisioning and troubleshooting.
  • Collaborate with DevOps and InfoSec teams to secure deployment processes.
  • Assess the existing platform for gaps and implement improvements, documenting processes.

Benefits

  • Competitive salary plus annual bonus potential.
  • Generous 401(k) plan with profit-sharing.
  • Tuition reimbursement and career development opportunities.
  • Comprehensive medical, dental, and vision plans with employee coverage cost covered.
  • Employee assistance and wellness programs.
  • Hybrid work model: 60% in-office, 40% remote.
  • Paid time off and parental leave.
  • Employer-paid life and disability insurance.
  • Free legal services and financial wellness programs.
Full Job Description
We're looking for a senior Platform engineer for GenAI Infrastructure to help build and operate the platform behind our agentic systems on AWS. The role covers how we deploy, secure, and run solutions- pipelines, infrastructure-as-code, IAM, networking, and the supporting data stores that our AI agents rely on. This role partners with our existing DevOps team and focuses on GenAI platform. This is a hands-on role on an existing platform. The work involves coming in, understanding what's there, and making it more secure, more reliable, and easier for AI teams to build on.

Responsibilities:
  • Work with architects and developers to deploy GenAI components (Bedrock, AgentCore, Lambda, APIs) safely and repeatably and able to troubleshoot.
  • Build and improve CI/CD pipelines and infrastructure code (AWS CDK, Bitbucket/GitHub pipelines).
  • Manage AWS environments end-to-end for GenAI: IAM, networking, deployments, secrets, logging, and monitoring.
  • Evolve secure GenAI deployment architecture where shared infrastructure (Bedrock access, agent runtimes, gateways, graph databases, Redis Database) is provisioned centrally and consumed.
  • Support the data stores our agents depend on - primarily a graph database and vector database. Provisioning, securing, backing up, and troubleshooting them in partnership with platform and infrastructure team.
  • Partner with the existing DevOps and InfoSec teams to harden deployment flows and document secure GenAI platform standards.
  • Ability to quickly assess an existing platform, identify gaps, and ship practical improvements and write clear runbooks and docs so the rest of the team can operate what gets built.

Qualifications:
  • 7+ years in DevOps, platform, or cloud infrastructure engineering.
  • Strong AWS background, including IAM, CloudFormation, Lambda, API Gateway, VPC, CloudWatch, SSM, Secrets Manager, and ECR.
  • Hands-on experience with AWS CDK, or strong CloudFormation/Terraform/CDK .
  • CI/CD pipeline experience in Bitbucket Pipelines, GitHub Actions, or similar including OIDC-based authentication
  • Solid IAM and security fundamentals - least-privilege policies, role assumption, trust policies.
  • Experience with containers and ECR for build and deploy workflows.
  • Comfort operating at least one database or data store in production - provisioning, backups, access control, basic tuning.

Preferred Qualifications:
  • Experience with AWS Bedrock, AgentCore, or any GenAI/LLM platform work.
  • Experience operating Neo4j, Neptune, or another graph database.
  • Experience operating VectorDB (Redis, Milvus or self-managed).
  • Experience with private networking patterns (VPC endpoints, private subnets) for Lambda or containerized workloads.
  • Experience supporting regulated or security-sensitive environments.

The base salary range for this position is $160,000 - $200,000 per year. This range reflects the minimum and maximum base salary we reasonably expect to pay for this role. In addition, this position may be eligible to participate in the relevant business unit's incentive compensation plan, and other compensation programs as applicable. Eligible employees may participate in a 401(k) program with a generous profit-sharing contribution, medical, prescription dental, and vision coverage; life insurance; disability coverage; paid holidays; vacation; and sick time, subject to plan terms and Company policies.

About Our Employee Rewards and Benefits:

We provide exceptional rewards and benefits that are among the best in the industry, giving our people access to a wide range of options, including:
  • Competitive base salary plus discretionary annual bonus for select positions
  • A 401(k) plan with a generous annual profit-sharing contribution
  • Personalized development and career opportunities, including tuition reimbursement support
  • Comprehensive medical, dental, and vision plans with zero contributions for employee coverage
  • Employee assistance (EAP) and wellness programs
  • Hybrid work environment: 60% in office, 40% remote for most positions
  • Paid time off and paid parental leave
  • Employer-paid life insurance and short- and long-term disability coverage
  • Legal services and financial wellness plans at no cost to employees

Similar Jobs

More Jobs at Bessemer Trust Company

More Information Technology Jobs

Find similar Gen AI Infrastructure Engineer jobs: