JP Morgan Chase & Co.

Lead Software Engineer and ML Engineer - Sales Copilot

JP Morgan Chase & Co. • $150K — $180K *
Finance & Insurance
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of software engineering experience with 4+ years in AI/ML solutions
  • Strong programming skills in Python with expertise in data structures and algorithms
  • Hands-on experience with LLM-powered applications in production
  • Deep proficiency in Kubernetes and Amazon EKS
  • Practical experience with retrieval quality and vector stores
  • Excellent communication skills for collaboration with technical and business stakeholders
  • In-depth knowledge of the financial services industry and IT systems

Responsibilities

  • Design and ship production agents on NEO from prototype to production
  • Build robust retrieval systems combining knowledge-graph traversal and vector search
  • Design and manage agent memory with recall and summarization policies
  • Oversee organizational context management for agent visibility
  • Compose multi-agent workflows and integrate tools through MCP servers
  • Conduct evaluations for task-level and end-to-end agent performance
  • Deploy and operate solutions on public cloud with strong SDLC practices

Benefits

  • Opportunity to work with cutting-edge AI technologies
  • Collaborative and agile team environment
  • Access to extensive resources and data from a leading financial institution
  • Professional development and training opportunities
  • Engagement with diverse business functions across the bank
Full Job Description
JOB DESCRIPTION

As a Lead Software Engineer at JPMorganChase within the Commercial and Investment bank Digital & Platform Services, Data Analytics, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives. 

JPMorganChase is hiring top talent to join the growing Commercial & Investment Bank Technology organization within Digital & Platform Services / Data Analytics, building production AI agents on NEO that leverage the firm’s scale, data, and full-service advantage to deliver measurable impact across the Commercial & Investment Bank and Payments. As a Senior AI Application Engineer, you’ll design, productionize, and operate LLM-powered agents on NEO (the firm’s agent runtime PaaS on AWS/Azure), partnering closely with business, product, and engineering teams in a fast-paced environment.

Job responsibilities

  • Design and ship production agents on NEO across the federated portfolio, owning them from prototype through production.
  • Build retrieval that holds up in production: Graph RAG combining knowledge-graph traversal with vector search, plus chunking, ranking, and grounding strategies that keep answers accurate and auditable.
  • Design agent memory: episodic and semantic memory organized as memory nodes, with recall, summarization, and decay policies tuned per use case.
  • Own organizational context management — assembling entitlement-, lineage-, and tenant-aware context so each agent reasons over only what it’s allowed to see.
  • Compose multi-agent workflows using A2A, and integrate tools and data through MCP servers (Bitbucket, Confluence, Databricks, Kubernetes, Snowflake, Splunk).
  • Build and run evals: task-level and end-to-end agent evaluations, regression suites, LLM-as-judge, and quality/safety gating before release.
  • Deploy and operate solutions on public cloud (AWS and, or Azure) with strong SDLC, security, resiliency, and observability practices.
  • Partner with product and business partners across CIB and Payments to turn use cases into shipped, supported agents.
  • Leads evaluation sessions with external vendors, startups, and internal teams to drive outcomes-oriented probing of architectural designs, technical credentials, and applicability for use within existing systems and information architecture

Required qualifications, capabilities, and skills

  • Formal training or certification on software engineering concepts and 5+ years applied experience with at least 4 years working on AI/ML solutions.
  • Hands-on practical experience delivering system design, application development, testing, and operational stability
  • Advanced in one or more programming language(s) - Strong programming skills in Python, with deep knowledge of data structures, algorithms, machine learning, data mining, information retrieval, and statistics.
  • Hands-on experience building LLM-powered or agentic applications in production, including tracing, evaluations, and guardrails.
  • Deep proficiency with Kubernetes and Amazon EKS, micro-VM isolation (e.g., Firecracker, Kata Containers, gVisor), and sidecar architectures, with proven experience designing defense in depth across the stack: network and mTLS, workload identity, fine-grained authorization, runtime isolation for untrusted or adversarial workloads, and application-level guardrails 
  • Practical RAG experience — retrieval quality, embeddings, and vector stores; Expert knowledge of at least one of: AWS, Azure, Kubernetes.
    Knowledge of data management and data model design; real-time processing using
    both SQL (e.g., Postgres) and NoSQL stores (e.g., OpenSearch, Redis).
  • Excellent communication skills with the ability to partner effectively with senior technical and business stakeholders.
  • Proficient in all aspects of the Software Development Life Cycle
  • Advanced understanding of agile methodologies such as CI/CD, Application Resiliency, and Security
  • In-depth knowledge of the financial services industry and their IT systems

 

Preferred qualifications, capabilities, and skills

  • MS in Computer Science, Statistics, Mathematics, Machine Learning, or related field (or equivalent experience).
  • Experience with agent frameworks or runtimes, A2A, or MCP. Agent memory design (memory nodes, episodic/semantic memory) and organizational context management.
  • Knowledge graphs and graph databases used for retrieval. Graph RAG a strong plus.
  • Understanding of LLM fine-tuning and small language model inference.
  • Ability to develop full-stack products using modern JavaScript/TypeScript frameworks (e.g., Next.js, Svelte) for agent UIs (AG-UI , NEO UI SDK).
  • Experience working in the financial or payments domain at a large institution (Investment Banking, Markets, Securities Services, or adjacent).
  • Knowledge of high-performance languages such as Go or Rust

About JP Morgan Chase & Co.

JP Morgan Chase & Co. stands at the forefront of the global financial services industry. They offer an expansive array of products and services to a diverse clientele, including individuals, corporations, governments, and institutions. Ever since the merger of J.P. Morgan & Co. and Chase Manhattan Corporation in 2000, this industry-leading entity has become renowned for its comprehensive portfolio encompassing consumer and community banking, corporate and investment banking, commercial banking, as well as asset and wealth management. Headquartered in the vibrant city of New York, JP Morgan Chase & Co. boasts a formidable presence across over 100 countries worldwide.

Unveiling Employment Opportunities at JP Morgan Chase & Co.

Vacancies and Hiring Initiatives

JP Morgan Chase & Co. is continuously on the lookout for talented individuals eager to contribute to its legacy of excellence. The company's recruitment efforts are geared towards identifying candidates with the right blend of skills and qualifications to drive forward its various business segments. Whether you are a seasoned professional or a recent graduate, JP Morgan Chase offers a plethora of job openings across multiple disciplines.

High-Demand Positions

Among the myriad of roles, certain positions stand out for their attractive compensation packages and career advancement prospects. Notably, high-paying jobs at JP Morgan Chase & Co. include Relationship Manager, Branch Manager, and Software Engineer. These roles are critical to the firm's operations and offer lucrative opportunities for those with the requisite expertise.

Navigating the Job Market at JP Morgan Chase & Co.

Leveraging Job Portals and Job Alerts

For job seekers aiming to tap into the opportunities at JP Morgan Chase, staying updated through job portals and subscribing to job alerts is crucial. These tools can provide timely information about job openings, job fairs, and recruitment events, enabling candidates to apply promptly and prepare adequately for interviews.

Preparing Your Job Application

Your job application, comprising your resume and cover letter, is your ticket to securing an interview at JP Morgan Chase. Highlight your qualifications, skills, and experiences that align with the job listing, ensuring you stand out in the competitive job market.

Acing the Interview

Preparation is key to succeeding in your interview with JP Morgan Chase. Familiarize yourself with the company's business segments, values, and recent achievements. Demonstrating how your background and aspirations match the company's goals can significantly increase your chances of employment. A World of Job Opportunites in the Financial Services Industry JP Morgan Chase & Co. offers a world of job opportunities for those seeking to make their mark in the financial services industry. With competitive salaries, comprehensive benefits, and endless possibilities for growth, positions at JP Morgan Chase are highly coveted. By staying informed through job sites, tailoring your applications, and preparing thoroughly for interviews, you can enhance your prospects of joining the esteemed ranks of JP Morgan Chase employees. Explore the job board, seize the job opportunities, and embark on a rewarding career journey with one of the world's leading financial institutions.
Learn more about JP Morgan Chase & Co.
Size
661 employees
Market Cap
$384.5 billion
Industry
Net Income
$29.1 billion
Founded
1823
5 Year Trend
+0.7%
Revenue
$261.5 million
NASDAQ

Similar Jobs

More Jobs at JP Morgan Chase & Co.

More Finance & Insurance Jobs

Find similar Lead Software Engineer and ML Engineer - Sales Copilot jobs: