Senior Vice President, Infrastructure Engineer

BNY Mellon

$150K — $200K *
Finance & Insurance
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in computer science or related field, advanced degree preferred
  • 8-10 years of relevant experience, preferably in securities or financial services
  • Proficient in Linux (RHEL/Ubuntu) administration, shell scripting, and system debugging
  • Hands-on experience with Kubernetes and Docker for containerized deployments
  • Familiar with NVIDIA GPU resource management and CI/CD workflows
  • Knowledge of networking basics and persistent storage systems
  • Experience with cloud platforms (AWS, GCP, Azure) and hybrid GPU environments
  • Ability to read and support Python code in ML/AI pipelines

Responsibilities

  • Manage NVIDIA AI infrastructure for high-performance ML/AI
  • Deploy and troubleshoot containerized AI workloads using Kubernetes and Docker
  • Oversee observability of AI platforms, identify performance issues
  • Automate infrastructure operations using Python, Bash, and automation tools
  • Maintain and scale AI training and inference pipelines through CI/CD integration

Benefits

  • Generous paid leaves including paid volunteer time
  • Access to flexible global resources for health and resilience
  • Opportunities for 401(k) enrollment with company sponsorship
  • Comprehensive medical, dental, vision, and basic life insurance plans
  • Competitive compensation and potential eligibility for annual incentives
Full Job Description
Job Description

AI Infrastructure Engineer

We're seeking a future team member for the role of Senior Vice President, AI Infrastructure Engineer to join our Technology team. This role is located in Lake Mary, FL or Pittsburgh, PA

In this role, you'll make an impact in the following ways:
  • Be hands-on with enterprise-grade NVIDIA AI infrastructure, supporting GPU-based compute, high-performance storage, and network systems designed for ML/AI at scale.
  • Deploy, monitor, and troubleshoot containerized AI workloads using Kubernetes, Docker, and GPU orchestration tools like Run:AI and NVIDIA BCM.
  • Own the observability of our AI platforms-monitor health, identify performance bottlenecks, and make strategic recommendations to drive platform reliability and maturity.
  • Automate infrastructure operations and provisioning using Python, Bash, and tools like Terraform or Ansible to reduce manual toil and accelerate experimentation.
  • Maintain and scale AI training and inference pipelines, integrating infrastructure workflows into CI/CD systems to enable seamless, automated deployment of AI workloads.

To be successful in this role, we're seeking the following:
  • Bachelor's degree in computer science or a related discipline, or equivalent work experience required; advanced degree preferred8-10 years of related experience required; experience in the securities or financial services industry is a plus.
  • Experience with Linux administration (RHEL/Ubuntu), shell scripting, and system-level debugging.
  • Proven experience running distributed systems in Kubernetes and containerized environments using Docker.
  • Familiarity with GPU resource management, including NVIDIA GPU Operator and device plugin lifecycle.
  • Experience with CI/CD workflows and infrastructure automation tools such as GitLab CI, Jenkins, Terraform, Helm, or Ansible.
  • Knowledge of networking fundamentals and persistent storage systems.
  • Exposure to cloud platforms (AWS, GCP, Azure) and hybrid GPU environments.
  • Ability to read and support Python code focused on ML/AI pipeline integration.
  • Strong analytical and troubleshooting skills with a collaborative mindset.
  • Effective communication skills and proactive ownership of platform reliability and performance.

Our Benefits and Rewards:

BNY offers highly competitive compensation, benefits, and wellbeing programs rooted in a strong culture of excellence and our pay-for-performance philosophy. We provide access to flexible global resources and tools for your life's journey. Focus on your health, foster your personal resilience, and reach your financial goals as a valued member of our team, along with generous paid leaves, including paid volunteer time, that can support you and your family through moments that matter.

BNY assesses market data to ensure a competitive compensation package for our employees. The expected base salary for this position when employment commences can be found in the Job Info section at the bottom of the posting.

Base salary offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. Base salary is only part of the total rewards package, which may include eligibility for an annual discretionary incentive award. Subject to the terms and conditions of the applicable plans then in effect, eligible employees may enroll in a 401(k) plan as well as participate in Company-sponsored medical, dental, vision, and basic life insurance plans for the employee and the employee's eligible dependents. Eligible employees also may receive other benefits (including various paid time off benefits, such as vacation and sick time), dependent on the position offered. Details of participation in these benefit plans will be provided if an employee receives an offer of employment.

If hired, the employee will be in an "at will" position and the Company reserves the right to modify base salary (as well as any other discretionary payments or compensation programs) at any time, including for reasons related to individual performance, Company or individual department/team performance, and market factors.

Similar Jobs

More Jobs at BNY Mellon

More Finance & Insurance Jobs

Find similar Senior Vice President, Infrastructure Engineer jobs: