JP Morgan Chase & Co.

Lead Software Engineer - AI/ML - AI Agent Platform

JP Morgan Chase & Co.$160K — $190K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of hands-on experience with AI and machine learning applications.
  • Advanced proficiency in Python and strong software engineering fundamentals.
  • Experience with deploying machine learning systems in production, ideally SDKs or library services.
  • Familiarity with prompt engineering and methods for improving language model performance.
  • Proven ability to make technical decisions in ambiguous situations and deliver results.
  • Strong communication skills for engaging with both technical and non-technical stakeholders.

Responsibilities

  • Lead delivery of the AI Agent Platform SDK from design through production deployment.
  • Own core platform components like agent orchestration and model-serving integration.
  • Develop operational voice and document extraction agents on the platform.
  • Drive improvement of capabilities such as NL2SQL through structured evaluation methods.
  • Establish engineering standards to enhance solution reliability and developer experience.
  • Build evaluation and observability tools for continuous quality enhancement.
  • Implement safety and governance mechanisms aligned with enterprise expectations.

Benefits

  • Access to continuous learning and professional development opportunities.
  • Collaborative work environment focused on strong engineering practices.
  • High visibility role impacting multiple teams and thousands of users across the organization.
  • Opportunity to shape the future of AI platforms in a major financial institution.
Full Job Description
JOB DESCRIPTION

Help shape how teams across the firm build AI agents. You will lead engineering for a flagship, high-visibility AI Agent Platform—the SDK, orchestration frameworks, and reusable components that power agentic AI experiences across the organization. Beyond any single chat experience, you will own the foundational tooling that lets teams compose agents—conversational, voice, and document-extraction—ground them in enterprise data, give them durable agentic memory, and continuously improve accuracy on hard capabilities like NL2SQL and RAG. You will raise delivery standards, turn complex problems into reliable production systems, and set the quality bar for infrastructure that many teams and thousands of users depend on. Join a team where strong engineering, thoughtful collaboration, and continuous learning are core to how we operate.

As Lead Software Engineer 6 AI Agent Platform at JPMorganChase within Enterprise Technology, AI and Machine Learning & Data Platforms, you will lead the technical design and delivery of the SDK and platform capabilities that enable large-language-model-powered agents at scale. You will own the building blocks agent orchestration, tool/function calling, retrieval and grounding, voice interaction, document extraction, and agentic memory and drive measurable, iterative improvement ("hill-climbing") of capabilities such as NL2SQL and RAG. You will translate high-impact problems into production-grade solutions, from discovery and design through deployment and ongoing operations, while partnering closely with product and stakeholder groups to deliver measurable outcomes.

Job responsibilities
  • Lead end-to-end delivery of the AI Agent Platform SDK and frameworks 6from problem framing and technical design through production deployment, scaling, and monitoring 6that engineering teams use to build, evaluate, and operate AI agents.
  • Own core platform services and reusable building blocks: agent orchestration, tool/function calling, retrieval-augmented generation pipelines, and model-serving integration.
  • Build and operate first-class agent modalities on the platform, including voice agents (speech-to-text, text-to-speech, low-latency streaming, and turn-taking), document-extraction agents (parsing, OCR, structured field and table extraction from complex documents), and agentic memory (short- and long-term memory, persistence, retrieval, and context management across sessions).
  • Drive systematic hill-climbing of core agent capabilities 6including NL2SQL, RAG, voice, document extraction, and tool use 6by building evaluation datasets, benchmarks, and quality metrics, then iterating on prompts, retrieval, and orchestration to measurably improve accuracy.
  • Establish engineering standards through hands-on system design, rigorous code review, and mentorship to improve reliability, maintainability, latency, and developer experience for teams building on the SDK.
  • Build and operationalize evaluation, testing, and observability capabilities (offline eval harnesses, regression suites, tracing, latency and cost telemetry, logs, and analytics) to continuously improve solution quality.
  • Implement robust safety and governance patterns 6guardrails, content filtering, prompt-injection defenses, access controls, and audit-ready operational practices aligned to enterprise expectations.
  • Partner with product managers and stakeholders to shape the roadmap, define success metrics (capability accuracy, adoption, task completion, quality), and prioritize work that delivers measurable business impact.
  • Drive cross-functional alignment across engineering, data, security, and risk partners to ensure the platform is secure, stable, performant, and scalable.
  • Contribute to technical documentation, SDK references, reference implementations, and enablement content that accelerates adoption and responsible usage.
Required qualifications, capabilities and skills
  • Formal training or certification on applied artificial intelligence and machine learning concepts and 5+ years applied experience.
  • Advanced proficiency in Python with strong software engineering fundamentals, including testing, design patterns, version control, and code review practices.
  • Hands-on experience building, evaluating, and deploying machine learning or large-language-model-enabled systems into production environments 6ideally reusable libraries, SDKs, or platform services consumed by other engineering teams.
  • Practical experience with prompt engineering and retrieval-augmented generation, including building evaluation methods, benchmarks, and quality measurement to systematically improve capabilities such as NL2SQL and RAG.
  • Experience designing and operating reliable services, including incident response readiness, performance tuning, and operational stability for data-intensive systems.
  • Demonstrated ability to lead technical decisions and deliver outcomes through ambiguity, balancing speed, risk, and long-term maintainability.
  • Strong communication skills with the ability to explain technical trade-offs to both technical and non-technical stakeholders.
Preferred qualifications, capabilities and skills
  • Experience with agent orchestration frameworks (for example, LangGraph, LlamaIndex, Google ADK, or custom orchestration) and evaluation tooling for LLM systems.
  • Experience building voice agents (speech recognition, text-to-speech, real-time streaming audio, and conversational turn-taking).
  • Experience building document-extraction / intelligent document-processing agents (OCR, layout parsing, structured field and table extraction from complex or unstructured documents).
  • Experience implementing agentic memory systems 6short- and long-term memory, persistence, and context retrieval across sessions.
  • Familiarity with vector databases, embedding pipelines, or graph-based memory approaches used in retrieval-augmented generation solutions.
  • Experience with continuous integration and continuous delivery practices and containerization (Docker and Kubernetes) for production deployments.
  • Experience with cloud and machine learning platforms (for example, Amazon Web Services, Databricks, or comparable platforms).

About JP Morgan Chase & Co.

JP Morgan Chase & Co. stands at the forefront of the global financial services industry. They offer an expansive array of products and services to a diverse clientele, including individuals, corporations, governments, and institutions. Ever since the merger of J.P. Morgan & Co. and Chase Manhattan Corporation in 2000, this industry-leading entity has become renowned for its comprehensive portfolio encompassing consumer and community banking, corporate and investment banking, commercial banking, as well as asset and wealth management. Headquartered in the vibrant city of New York, JP Morgan Chase & Co. boasts a formidable presence across over 100 countries worldwide.

Unveiling Employment Opportunities at JP Morgan Chase & Co.

Vacancies and Hiring Initiatives

JP Morgan Chase & Co. is continuously on the lookout for talented individuals eager to contribute to its legacy of excellence. The company's recruitment efforts are geared towards identifying candidates with the right blend of skills and qualifications to drive forward its various business segments. Whether you are a seasoned professional or a recent graduate, JP Morgan Chase offers a plethora of job openings across multiple disciplines.

High-Demand Positions

Among the myriad of roles, certain positions stand out for their attractive compensation packages and career advancement prospects. Notably, high-paying jobs at JP Morgan Chase & Co. include Relationship Manager, Branch Manager, and Software Engineer. These roles are critical to the firm's operations and offer lucrative opportunities for those with the requisite expertise.

Navigating the Job Market at JP Morgan Chase & Co.

Leveraging Job Portals and Job Alerts

For job seekers aiming to tap into the opportunities at JP Morgan Chase, staying updated through job portals and subscribing to job alerts is crucial. These tools can provide timely information about job openings, job fairs, and recruitment events, enabling candidates to apply promptly and prepare adequately for interviews.

Preparing Your Job Application

Your job application, comprising your resume and cover letter, is your ticket to securing an interview at JP Morgan Chase. Highlight your qualifications, skills, and experiences that align with the job listing, ensuring you stand out in the competitive job market.

Acing the Interview

Preparation is key to succeeding in your interview with JP Morgan Chase. Familiarize yourself with the company's business segments, values, and recent achievements. Demonstrating how your background and aspirations match the company's goals can significantly increase your chances of employment. A World of Job Opportunites in the Financial Services Industry JP Morgan Chase & Co. offers a world of job opportunities for those seeking to make their mark in the financial services industry. With competitive salaries, comprehensive benefits, and endless possibilities for growth, positions at JP Morgan Chase are highly coveted. By staying informed through job sites, tailoring your applications, and preparing thoroughly for interviews, you can enhance your prospects of joining the esteemed ranks of JP Morgan Chase employees. Explore the job board, seize the job opportunities, and embark on a rewarding career journey with one of the world's leading financial institutions.
Learn more about JP Morgan Chase & Co.
Size
661 employees
Market Cap
$384.5 billion
Industry
Net Income
$29.1 billion
Founded
1823
5 Year Trend
+0.7%
Revenue
$261.5 million
NASDAQ

Similar Jobs

More Jobs at JP Morgan Chase & Co.

More Information Technology Jobs

Find similar Lead Software Engineer - AI/ML - AI Agent Platform jobs: