JP Morgan Chase & Co.

Senior Lead Software Engineer, AI Platforms

JP Morgan Chase & Co.$150K — $180K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of hands-on experience in software engineering and infrastructure for ML workloads.
  • Expertise in GPU infrastructure and related technologies (accelerators, distributed compute).
  • Proficient with Kubernetes and containerization (Docker) for orchestration and management.
  • Strong in at least one programming language (Python, Go, Java, or C#).
  • Ability to solve complex scalability and reliability issues independently.
  • In-depth understanding of cloud architecture (microservices, networking, security).
  • Experience leading the adoption of AI-assisted development tools in the engineering lifecycle.

Responsibilities

  • Design and deliver secure, high-quality production code while improving existing code.
  • Architect and optimize scalable cloud infrastructure for ML workloads.
  • Collaborate with AI/ML teams to define platform capabilities based on technical requirements.
  • Drive architectural decisions that shape application functionality and operational strategy.
  • Monitor and optimize cloud resources for performance and cost efficiency.
  • Develop CI/CD pipelines and infrastructure-as-code solutions for streamlined operations.
  • Guide engineers and contractors to ensure solutions meet business and security standards.

Benefits

  • Access to cutting-edge technology and tools in cloud and AI/ML infrastructure.
  • Opportunities for career advancement within JPMorganChase's diverse engineering teams.
  • Supportive culture fostering collaboration and technical innovation.
  • Engagement in agile methodologies that promote rapid iteration and improvement.
Full Job Description
JOB DESCRIPTION

Be an integral part of an agile engineering team that is constantly pushing the boundaries of what is possible across cloud, infrastructure, and AI/ML platforms.

As aSenior Lead Software Engineer at JPMorganChase within the Corporate Sector, Infrastructure Platforms team, you will play a critical role in designing, building, and operating secure, scalable, and resilient infrastructure platforms that power enterprise AI/ML workloads. You will help deliver market-leading technology products in a secure, stable, and highly available manner while driving meaningful business impact through deep technical expertise, engineering leadership, and strong problem-solving capabilities.

In this role, you will partner closely with AI/ML engineering teams, platform teams, product owners, and infrastructure stakeholders to translate complex compute, storage, networking, GPU, and scalability requirements into production-ready platforms formulti-GPU and multi-node model training. You will also help advance automation, developer productivity, responsible AI-assisted engineering practices, and operational excellence across the software delivery lifecycle.

Job Responsibilities

  • Design, develop, test, and deliver secure, high-quality production code; review, debug, and improve code written by others.
  • Architect, build, and operate secure, scalable cloud infrastructure platforms optimized for multi-GPU and multi-node AI/ML training workloads.
  • Partner with AI/ML, data science, and platform engineering teams to translate compute, storage, networking, GPU, and scalability needs into robust infrastructure requirements and platform capabilities.
  • Drive technical design decisions that influence product architecture, application functionality, infrastructure strategy, and operational effectiveness.
  • Monitor, manage, and optimize cloud and GPU infrastructure resources for performance, reliability, utilization, scalability, and cost efficiency.
  • Build and maintain CI/CD pipelines, automation frameworks, and infrastructure-as-code solutions to streamline ML platform deployment, operations, and lifecycle management.
  • Provide technical leadership and guidance to engineers, contractors, and vendor partners, ensuring solutions align with business priorities, engineering standards, security expectations, and long-term platform strategy.
  • Apply deep knowledge of the Software Development Life Cycle toolchain, including enterprise-approved AI-assisted development and automation capabilities, to improve engineering productivity and automation at scale.
  • Champion firmwide SDLC frameworks, engineering standards, secure coding practices, resiliency expectations, and operational best practices.
  • Drives adoption and governance of approved AI-assisted engineering practices across teams to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test acceleration, release readiness, incident/root-cause analysis), while establishing measurable validation standards (secure coding, peer review, automated testing) and promoting reuse of proven patterns and automation within the SDLC/TLM toolchain.
  • Applies knowledge of tools within the Software Development Life Cycle toolchain, including approved AI-assisted development and automation capabilities, to improve the value realized by automation at scale.

Required qualifications, capabilities and skills

  • Formal training or certification on software engineering concepts and 5+ years applied experience
  • Hands-on experience building highly scalable and highly available infrastructure for machine learning training and/or inference workloads.
  • Solid system-level understanding of GPU infrastructure, accelerators, high-speed interconnects, distributed compute, and related platform technologies.
  • Strong experience with Kubernetes and containerization technologies, including Docker, cluster operations, workload scheduling, observability, and production troubleshooting.
  • Proficiency in at least one modern programming language, such as Python, Go, Java, or C#.
  • Demonstrated ability to independently solve complex design, scalability, reliability, performance, and functionality challenges with minimal oversight.
  • Deep understanding of cloud component architecture, including microservices, compute, storage, networking, security, routing, and switching technologies.
  • Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools for coding, code review, test acceleration, troubleshooting, and engineering productivity.
  • Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security
  • Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching senior engineers/leads on compliant usage patterns and controls.
  • Design, develop, test, and deliver secure, high-quality production code; review, debug, and improve code written by others.

Preferred Qualifications, Capabilities, and Skills

  • Hands-on experience with performance monitoring, production debugging, profiling, sampling, bottleneck analysis, and capacity optimization.
  • Foundational understanding of NVIDIA GPU infrastructure software and ecosystem tooling, such as DCGM, BCM, NVIDIA drivers, CUDA, and training libraries.
  • Experience with MLOps platforms and tooling, including MLflow or similar model lifecycle management solutions.
  • Background in high-performance computing, distributed systems, and ML frameworks, including distributed training, Ray.io, Slurm, or similar workload orchestration technologies.
  • Strong knowledge of network architecture, including high-throughput and low-latency networking patterns for distributed compute and AI/ML workloads.
  • Familiarity with cloud data services, big data processing platforms, Linux systems, and storage technologies used in large-scale data and ML environments.
  • Experience designing platforms that support model training, experiment tracking, feature pipelines, model serving, and scalable inference in enterprise environments.

About JP Morgan Chase & Co.

JP Morgan Chase & Co. stands at the forefront of the global financial services industry. They offer an expansive array of products and services to a diverse clientele, including individuals, corporations, governments, and institutions. Ever since the merger of J.P. Morgan & Co. and Chase Manhattan Corporation in 2000, this industry-leading entity has become renowned for its comprehensive portfolio encompassing consumer and community banking, corporate and investment banking, commercial banking, as well as asset and wealth management. Headquartered in the vibrant city of New York, JP Morgan Chase & Co. boasts a formidable presence across over 100 countries worldwide.

Unveiling Employment Opportunities at JP Morgan Chase & Co.

Vacancies and Hiring Initiatives

JP Morgan Chase & Co. is continuously on the lookout for talented individuals eager to contribute to its legacy of excellence. The company's recruitment efforts are geared towards identifying candidates with the right blend of skills and qualifications to drive forward its various business segments. Whether you are a seasoned professional or a recent graduate, JP Morgan Chase offers a plethora of job openings across multiple disciplines.

High-Demand Positions

Among the myriad of roles, certain positions stand out for their attractive compensation packages and career advancement prospects. Notably, high-paying jobs at JP Morgan Chase & Co. include Relationship Manager, Branch Manager, and Software Engineer. These roles are critical to the firm's operations and offer lucrative opportunities for those with the requisite expertise.

Navigating the Job Market at JP Morgan Chase & Co.

Leveraging Job Portals and Job Alerts

For job seekers aiming to tap into the opportunities at JP Morgan Chase, staying updated through job portals and subscribing to job alerts is crucial. These tools can provide timely information about job openings, job fairs, and recruitment events, enabling candidates to apply promptly and prepare adequately for interviews.

Preparing Your Job Application

Your job application, comprising your resume and cover letter, is your ticket to securing an interview at JP Morgan Chase. Highlight your qualifications, skills, and experiences that align with the job listing, ensuring you stand out in the competitive job market.

Acing the Interview

Preparation is key to succeeding in your interview with JP Morgan Chase. Familiarize yourself with the company's business segments, values, and recent achievements. Demonstrating how your background and aspirations match the company's goals can significantly increase your chances of employment. A World of Job Opportunites in the Financial Services Industry JP Morgan Chase & Co. offers a world of job opportunities for those seeking to make their mark in the financial services industry. With competitive salaries, comprehensive benefits, and endless possibilities for growth, positions at JP Morgan Chase are highly coveted. By staying informed through job sites, tailoring your applications, and preparing thoroughly for interviews, you can enhance your prospects of joining the esteemed ranks of JP Morgan Chase employees. Explore the job board, seize the job opportunities, and embark on a rewarding career journey with one of the world's leading financial institutions.
Learn more about JP Morgan Chase & Co.
Size
661 employees
Market Cap
$384.5 billion
Industry
Net Income
$29.1 billion
Founded
1823
5 Year Trend
+0.7%
Revenue
$261.5 million
NASDAQ

Similar Jobs

More Jobs at JP Morgan Chase & Co.

More Enterprise Technology Jobs

Find similar Senior Lead Software Engineer, AI Platforms jobs: