The Goldman Sachs Group, Inc

Senior AI/ML Engineer, Global Banking & Markets, Front Office Technology

The Goldman Sachs Group, Inc$150K — $300K *
Finance & Insurance
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Expert-level proficiency in Java 21+ with experience in high-concurrency AI inference using Virtual Threads/Project Loom.
  • Hands-on experience with leading AI frameworks/tools for production solutions.
  • Deep knowledge of Spring Boot 3.x, JPA, Sybase, and Maven/Gradle in enterprise settings.
  • Proficient in SQL and integrating Java clients with enterprise vector stores like Milvus, Weaviate, or Pinecone.
  • Experience with Apache Kafka or RabbitMQ for asynchronous task orchestration in AI workflows.
  • Demonstrable experience deploying on AWS using relevant SDKs.
  • 6+ years in Java software engineering with 3+ years in AI/ML integration.

Responsibilities

  • Architect and implement AI pipelines that integrate with existing enterprise APIs and microservices.
  • Optimize inference latency and manage token costs for large-scale AI deployments.
  • Establish evaluation frameworks to measure model performance and ensure compliance with security standards.
  • Collaborate with cross-functional teams to identify AI use cases and define technical roadmaps.
  • Stay updated on advancements in Generative AI and recommend strategic technology pivots.
  • Build RAG systems using Java-based ETL pipelines to handle unstructured data ingestion.
  • Monitor LLM latency and model drift using enterprise monitoring tools and frameworks.

Benefits

  • Comprehensive and competitive benefits offerings designed to enhance employee experience.
  • Wellness offerings tailored to the needs of full-time and part-time employees working at least 20 hours per week.
  • Access to a supportive work environment that emphasizes career development and resilience.
Full Job Description
Job Description

Who We Look For

We are seeking a Senior AI Engineering Expert with deep expertise in leveraging the latest and greatest AI tooling to drive developing solutions on the Java/JVM based ecosystem. You will be responsible for architecting and implementing production-grade AI solutions that integrate directly into our existing Java-based microservices. Your primary focus will be on building scalable, type-safe, and observable AI "Agentic" workflows that automate collateral management, risk monitoring, and advisor support.

How You Will Fulfill Your Potential
  • System Integration: Architect and implement end-to-end AI pipelines (RAG, Agentic workflows) that integrate seamlessly with existing enterprise APIs, legacy databases, and microservices.
  • Scalability & Performance: Optimize inference latency and manage token costs for large-scale deployments serving thousands of internal and external users.
  • Evaluation & Governance: Establish robust evaluation frameworks to measure model accuracy, mitigate hallucinations, and ensure compliance with enterprise security and privacy standards.
  • Cross-Functional Leadership: Collaborate with tech leads, security leads, and software teams to identify high-impact AI use cases and define technical roadmaps.
  • Continuous Innovation: Stay at the forefront of Generative AI, multimodal models, and autonomous agents, recommending strategic pivots as the technology evolves.
  • Enterprise RAG Pipelines: Build robust Retrieval-Augmented Generation (RAG) systems using Java-based ETL pipelines to ingest and index unstructured custodial data (e.g., legal agreements, market news) into vector databases.
  • Performance & Observability: Leverage Spring Boot Actuator and Micrometer to monitor LLM latency, token usage, and model drift within our standard enterprise monitoring stack.
  • Regulatory Compliance (Audit-by-Design): Implement "Human-in-the-Loop" (HITL) patterns and structured logging to ensure all AI-driven lending decisions are explainable and compliant with 2026 SEC/FINRA standards.
  • System Modernization: Lead the transition of traditional batch-oriented Java processes to real-time, event-driven AI architectures using AWS MSK and similar tools.


Required Technical Skills
  • Core Java: Expert-level proficiency in Java 21+ (utilizing Virtual Threads/Project Loom for high-concurrency AI inference).
  • AI Frameworks: Hands-on experience with leading AI frameworks / tools.
  • Enterprise Stack: Deep experience with Spring Boot 3.x, JPA, Sybase, and Maven/Gradle.
  • Data & Search: Proficiency in SQL and integration with enterprise vector stores (e.g., Milvus, Weaviate, or Pinecone) via Java clients.
  • Messaging & Integration: Experience with Apache Kafka or RabbitMQ for orchestrating asynchronous AI agent tasks.
  • Cloud Infrastructure: Deployment experience on AWS usingSDKs.


Qualifications
  • Experience: 6+ years in Java software engineering, with at least 3 years focused on AI/ML integration in production.
  • Domain Knowledge: Understanding of RIA workflows, collateral eligibility, and the regulatory landscape of asset-based lending.
  • Education: Degree in Computer Science, Financial Engineering, or a related field.


Salary Range
The expected base salary for this New York, New York, United States-based position is $150,000-$300,000. In addition, you may be eligible for a discretionary bonus if you are an active employee as of fiscal year-end.

Benefits
Goldman Sachs is committed to providing our people with valuable and competitive benefits and wellness offerings, as it is a core part of providing a strong overall employee experience. A summary of these offerings, which are generally available to active, non-temporary, full-time and part-time US employees who work at least 20 hours per week, can be found here.

About The Goldman Sachs Group, Inc

The Goldman Sachs Group, Inc. provides investment banking, securities, and investment management services, as well as financial services to corporations, financial institutions, governments, and high-net-worth individuals worldwide. Its Investment Banking segment offers financial advisory services, including advisory assignments concerning mergers and acquisitions, divestitures, corporate defense, risk management, and restructurings and spin-offs; and underwriting services comprising public offerings and private placements of a range of securities, loans, and other financial instruments, and derivative transactions. The company’s Institutional Client Services segment provides client execution services, such as fixed income, currency, and commodities client execution related to making markets in interest rate products, credit products, mortgages, currencies, and commodities; and equities related to making markets in equity products, as well as executes and clears institutional client transactions on stock, options, and futures exchanges. This segment also engages in the securities services business providing financing, securities lending, and other brokerage services to institutional clients, including hedge funds, mutual funds, pension funds, and foundations. Its Investing and Lending segment originates longer-term loans; and invests in debt securities, loans, public and private equity securities, real estate, consolidated investment entities, distressed assets, currencies, commodities, and power generation facilities. The company’s investment management segment provides investment products and services, as well as offers wealth advisory services, including portfolio management and financial counseling, and brokerage and other transaction services.

The Goldman Sachs Group, Inc. Careers

Join the prestigious team at The Goldman Sachs Group, Inc., a global leader in finance and investments, and propel your career to new heights. Our firm is renowned for its commitment to excellence, innovation, and leadership in the financial sector.

Work You’ll Do

At Goldman Sachs, you will be part of a dynamic environment that fosters growth, diversity, and professional development. Engage in transformative projects that redefine the landscape of global finance, driven by a culture of high performance and continuous improvement.

Lead with Innovation and Leadership

Step into a role where your skills will be honed and your leadership capabilities enhanced. The Goldman Sachs Group, Inc. is at the forefront of merging financial expertise with technological innovation, creating a platform for you to lead impactful initiatives.

Join Our Diverse and Inclusive Team

Diversity and inclusion are at the core of our company culture. With employees from various backgrounds, Goldman Sachs thrives on the rich ideas and perspectives that this diversity brings. Here, every team member’s contribution is valued, and every voice is heard.

Explore Job Opportunities and Internships

Whether you’re seeking full-time employment or looking into internship opportunities, Goldman Sachs offers a range of positions that cater to different skills, experiences, and career aspirations. From analyst to executive positions, discover how you can contribute to our legacy of success.

Networking and Professional Growth

Goldman Sachs is not just a workplace. It is a community where you can build lasting relationships with colleagues and industry leaders. Our networking events, mentorship programs, and professional groups foster connections that can accelerate your career trajectory.

Benefits and Career Development

Invest in your future with Goldman Sachs’ unparalleled employee benefits and career development programs. From comprehensive health benefits to personalized career coaching and leadership training, we ensure that our team is equipped for success, both professionally and personally.

Prepare for Your Future

Ready to take the next step? Prepare your resume, sharpen your interview skills, and explore the vast array of job opportunities at The Goldman Sachs Group, Inc. Our hiring process is designed to identify and nurture talent, helping you to achieve your career goals.

Stay Connected

Keep up to date with the latest from Goldman Sachs Careers by subscribing to our job alert emails. Tailor your preferences to receive updates that match your career interests and stay ahead in the competitive financial sector.

Join The Goldman Sachs Group, Inc.

Embark on a rewarding journey with The Goldman Sachs Group, Inc. where your potential is limitless. Explore positions, read about our company culture, and apply today to become part of a team that values growth, leadership, and innovation.

SEARCH GOLDMAN SACHS JOBS

READ CAREERS BLOG

At The Goldman Sachs Group, Inc., your career is just the beginning – it’s an opportunity to excel and lead in the global financial industry. Join us and make your mark!
Learn more about The Goldman Sachs Group, Inc
Size
45,100 employees
Market Cap
$115.8 billion
Industry
Net Income
$9.4 billion
Founded
1869
5 Year Trend
+11.3%
Revenue
$53.4 billion
NASDAQ

Similar Jobs

More Jobs at The Goldman Sachs Group, Inc

More Finance & Insurance Jobs

Find similar Senior AI/ML Engineer, Global Banking & Markets, Front Office Technology jobs: