JP Morgan Chase & Co.

Senior Lead Software Engineer- AI/ML Platform

JP Morgan Chase & Co.$145K — $175K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of software engineering experience with formal training or certification
  • Proficient in Python or Java for writing secure production-quality code
  • Strong knowledge of distributed systems and microservices architecture
  • Experience with cloud-native infrastructure (AWS, networking, security)
  • Expertise in infrastructure-as-code using Terraform in large cloud environments
  • Hands-on experience with Docker, Kubernetes, and AWS EKS
  • Exposure to AI/ML platforms and GPU infrastructure for model serving

Responsibilities

  • Build and maintain scalable AI/ML platform infrastructure and shared services
  • Architect and operate cloud and container environments for AI workloads
  • Design and implement automation and infrastructure-as-code solutions
  • Develop production-grade services, APIs, and workflows for model management
  • Collaborate with cross-functional teams on platform standards and deployment
  • Optimize reliability, scalability, and cost for the AI/ML platform
  • Establish best practices for operational monitoring and troubleshooting
  • Drive adoption of AI-assisted engineering practices and set validation standards

Benefits

  • Access to a team-driven agile environment
  • Opportunity to work with cutting-edge AI/ML technologies
  • Professional development and training opportunities
  • Collaborative culture promoting innovation and creativity
  • Involvement in significant projects with measurable business impact
Full Job Description
JOB DESCRIPTION

Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products.

As a Senior Lead Software Engineer at JPMorgan Chase within Corporate - AIML Data Platforms team , you will design, build, and operate the foundational cloud infrastructure that enables data scientists and machine learning engineers to develop, train, and deploy intelligent solutions across the firm. In this role you will serve as a technical leader, driving platform reliability, scalability, and automation while collaborating with cross-functional teams to solve complex infrastructure challenges. Your work will directly accelerate the firm’s AI/ML capabilities—enabling faster experimentation and production-grade deployments that create measurable business impact.

Job Responsibilities

  • Builds and maintains reusable AI/ML platform infrastructure and shared services to support development, deployment, and operations at scale.
  • Architects, deploys, and operates secure cloud and container-based environments for training and inference, including GPU-intensive workloads.
  • Design and implement platform tooling, automation, and infrastructure-as-code solutions to streamline model deployment, environment provisioning, release management, and operational support.
  • Develops and maintains production-grade services, APIs, SDK integrations, and workflows that support model training, serving, evaluation pipelines, and AI application lifecycle management.
  • Partners with data science, ML engineering, and application teams to translate model and compute requirements into platform standards and deployment patterns.
  • Optimizes platform reliability, scalability, latency, and cost through orchestration, scheduling, and hardware acceleration.
  • Establishes operational best practices including monitoring, logging, observability, access controls, incident response, and production troubleshooting.
  • Supports enterprise LLM operationalization, including fine-tuning workflows, inference optimization, and evaluation; contribute to documentation and engineering standards.
  • Drives adoption and governance of approved AI-assisted engineering practices across teams to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test acceleration, release readiness, incident/root-cause analysis), while establishing measurable validation standards (secure coding, peer review, automated testing) and promoting reuse of proven patterns and automation within the SDLC/TLM toolchain.
  • Applies knowledge of tools within the Software Development Life Cycle toolchain, including approved AI-assisted development and automation capabilities, to improve the value realized by automation at scale.

Required Qualifications, Capabilities, and Skills

  • Formal training or certification on software engineering concepts and 5+ years applied experience
  • Experience delivering secure, production-quality code in Python or Java.
  • Strong foundations in distributed systems, microservices, and platform architecture/design principles.
  • Proven ability to architect and operate cloud-native infrastructure on AWS (compute, networking, storage, security) and other major clouds.
  • Demonstrated expertise with infrastructure-as-code tooling, specifically Terraform, in large-scale cloud environments.
  • Hands-on experience with Docker and Kubernetes, including AWS EKS operations.
  • Experience building or supporting production AI/ML platforms (training, deployment, and model serving/inference), including GPU infrastructure/tooling.
  • Strong DevOps/platform engineering practices: CI/CD, release automation, automated testing, and observability (monitoring/logging/tracing).
  • Experience with SQL/NoSQL databases and data integration; strong Linux, scripting, and networking fundamentals.
  • Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security
  • Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching senior engineers/leads on compliant usage patterns and controls.

Preferred Qualifications, Capabilities, and Skills

  • Proficiency in Go or Python for automation, tooling development, or platform service implementation.
  • Experience with MLOps frameworks and tools such as Kubeflow, MLflow, or similar AI/ML lifecycle management platforms.
  • Working knowledge of ML frameworks (PyTorch, TensorFlow, Hugging Face, scikit-learn) for model integration and operationalization.
  • Exposure to multi-cloud or hybrid cloud architectures and platform portability strategies.

About JP Morgan Chase & Co.

JP Morgan Chase & Co. stands at the forefront of the global financial services industry. They offer an expansive array of products and services to a diverse clientele, including individuals, corporations, governments, and institutions. Ever since the merger of J.P. Morgan & Co. and Chase Manhattan Corporation in 2000, this industry-leading entity has become renowned for its comprehensive portfolio encompassing consumer and community banking, corporate and investment banking, commercial banking, as well as asset and wealth management. Headquartered in the vibrant city of New York, JP Morgan Chase & Co. boasts a formidable presence across over 100 countries worldwide.

Unveiling Employment Opportunities at JP Morgan Chase & Co.

Vacancies and Hiring Initiatives

JP Morgan Chase & Co. is continuously on the lookout for talented individuals eager to contribute to its legacy of excellence. The company's recruitment efforts are geared towards identifying candidates with the right blend of skills and qualifications to drive forward its various business segments. Whether you are a seasoned professional or a recent graduate, JP Morgan Chase offers a plethora of job openings across multiple disciplines.

High-Demand Positions

Among the myriad of roles, certain positions stand out for their attractive compensation packages and career advancement prospects. Notably, high-paying jobs at JP Morgan Chase & Co. include Relationship Manager, Branch Manager, and Software Engineer. These roles are critical to the firm's operations and offer lucrative opportunities for those with the requisite expertise.

Navigating the Job Market at JP Morgan Chase & Co.

Leveraging Job Portals and Job Alerts

For job seekers aiming to tap into the opportunities at JP Morgan Chase, staying updated through job portals and subscribing to job alerts is crucial. These tools can provide timely information about job openings, job fairs, and recruitment events, enabling candidates to apply promptly and prepare adequately for interviews.

Preparing Your Job Application

Your job application, comprising your resume and cover letter, is your ticket to securing an interview at JP Morgan Chase. Highlight your qualifications, skills, and experiences that align with the job listing, ensuring you stand out in the competitive job market.

Acing the Interview

Preparation is key to succeeding in your interview with JP Morgan Chase. Familiarize yourself with the company's business segments, values, and recent achievements. Demonstrating how your background and aspirations match the company's goals can significantly increase your chances of employment. A World of Job Opportunites in the Financial Services Industry JP Morgan Chase & Co. offers a world of job opportunities for those seeking to make their mark in the financial services industry. With competitive salaries, comprehensive benefits, and endless possibilities for growth, positions at JP Morgan Chase are highly coveted. By staying informed through job sites, tailoring your applications, and preparing thoroughly for interviews, you can enhance your prospects of joining the esteemed ranks of JP Morgan Chase employees. Explore the job board, seize the job opportunities, and embark on a rewarding career journey with one of the world's leading financial institutions.
Learn more about JP Morgan Chase & Co.
Size
661 employees
Market Cap
$384.5 billion
Industry
Net Income
$29.1 billion
Founded
1823
5 Year Trend
+0.7%
Revenue
$261.5 million
NASDAQ

Similar Jobs

More Jobs at JP Morgan Chase & Co.

More Information Technology Jobs

Find similar Senior Lead Software Engineer- AI/ML Platform jobs: