The Goldman Sachs Group, Inc

Software Engineering - Data, Lakehouse and AI Data Platform Engineer - Associate - New York

The Goldman Sachs Group, Inc • $100K — $130K *
New York, NY 10025In-Person
Information Technology
Less than 5 years of experience
Reposted Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 0-2+ years of experience in data engineering
  • Bachelor's or master's degree in a relevant discipline or equivalent practical experience
  • Strong hands-on programming experience in Python or Java
  • Good working knowledge of SQL, including troubleshooting and optimization
  • Ability to learn new tools and delivery workflows quickly
  • Familiarity with software engineering fundamentals, including version control and CI/CD practices

Responsibilities

  • Build, enhance and support batch and streaming data pipelines
  • Refactor existing data flows to improve reliability and performance
  • Ensure data pipelines are production-ready and well tested
  • Develop raw, refined and curated datasets for analytics and AI
  • Implement controls to validate data completeness and accuracy
  • Work closely with engineers and data consumers to deliver outcomes
  • Communicate clearly on progress and risks, and lead with technical guidance for junior engineers

Benefits

  • Opportunity to work with a modern data stack and evolving technologies
  • Collaborative engineering environment that fosters innovation
  • Potential for technical leadership roles for experienced candidates
  • Focus on reliable, structured solutions that support business outcomes
  • Engagement with diverse teams and stakeholders to enhance data products
Full Job Description
Job Description

The Opportunity

Join a team building the data foundations that support the firm's AI and analytics capabilities. This role sits within the engineering effort to develop a modern Lakehouse and AI data platform that enables reliable, well-governed and high-performing data use across the firm.

At Goldman Sachs, engineering teams are positioned at the centre of the business, building scalable systems, solving complex technical problems and turning data into action. In data engineering roles, the emphasis is on designing, building and maintaining large-scale data platforms, delivering production pipelines, improving reliability and quality, and partnering closely with users of the platform.

This is a delivery-focused role for engineers who want to build robust data assets in production, work with modern data technologies, and grow over time within the firm. You will contribute to the data models, pipelines and platform capabilities that underpin analytics, operational decision-making and emerging AI use cases, and may also help extend platform tooling where additional functionality is needed.

Role Summary

As a Data Engineer in the Lakehouse and AI Data Platform team, you will design, build, test and support data pipelines and curated datasets on the firm's modern data platform. You will work across ingestion, transformation, modelling, optimisation and data quality, helping to deliver data products that are reliable, scalable and fit for purpose. Where there are gaps in platform functionality, you may also contribute to shared tooling or framework components that improve how the platform is used and operated.

The role is suited to engineers who are comfortable writing code, working with SQL and distributed data processing, and solving practical delivery problems in a team environment. More experienced candidates may also contribute to technical design, platform standards and the shaping of delivery approaches across a wider set of use cases.

Key Responsibilities

Pipeline Engineering
  • Build, enhance and support batch and streaming data pipelines on the Lakehouse and AI data platform.
  • Refactor or modernise existing data flows where needed to improve reliability, performance and maintainability.
  • Where needed, build reusable tooling to improve delivery, consistency and operational support.
  • Ensure data pipelines are production-ready, well tested and operationally supportable.

Data Modelling and Curation
  • Develop raw, refined and curated datasets that support analytics, reporting and AI use cases.
  • Apply sound data modelling principles to represent business entities, relationships and historical change accurately.
  • Work with consumers to shape data products that are usable, well documented and aligned to business needs.

Data Quality and Reconciliation
  • Implement controls to validate completeness, accuracy and consistency of data across pipelines and datasets.
  • Use reconciliation approaches to build confidence in production outputs and investigate breaks where they arise.
  • Contribute to clear standards for testing, monitoring and issue resolution.
  • Contribute to practical improvements in testing, monitoring or reconciliation tooling where these strengthen platform reliability and day-to-day delivery.

Delivery and Partnership
  • Work closely with engineers, platform teams and data consumers to deliver agreed outcomes to time and quality expectations.
  • Communicate clearly on progress, risks, dependencies and design choices, including where delivery would benefit from improvements to shared platform tooling.
  • For more senior candidates, take a broader role in technical leadership, task breakdown and support for junior engineers.


Skills and Experience

Required
  • 0-2+ years of experience
  • Bachelor's or master's degree in a relevant discipline, or equivalent practical experience, with evidence of strong quantitative skills or data engineering expertise.
  • Strong hands-on programming experience in Python or Java.
  • Good working knowledge of SQL, including troubleshooting, optimization and data analysis.
  • Ability to learn new tools, internal platforms and delivery workflows quickly.
  • Familiarity with software engineering fundamentals, including version control, testing, release discipline and CI/CD practices.


Data Engineering Capability
  • Understanding of temporal data modelling, including the handling of historical state and change over time.
  • Knowledge of schema design, schema evolution and data compatibility considerations.
  • Understanding of partitioning, clustering and other techniques used to improve data performance at scale.
  • Ability to make sensible design choices across normalized and denormalized models, and between natural and surrogate keys.
  • Practical approach to data quality, reconciliation and root-cause analysis.
  • Experience building or supporting production data pipelines in a collaborative engineering environment.
  • Experience working with distributed data processing frameworks such as Apache Spark.
  • Working knowledge of common data formats such as JSON, Avro and Parquet.

Technology Environment

The role will involve working with a modern and evolving data stack. Candidates are not expected to have deep expertise in every tool from day one but should bring relevant experience and the ability to work across comparable technologies.

Examples of technologies in scope include:
  • Data processing and logic: ANSI SQL, Apache Spark, Kafka
  • Data formats: JSON, Avro, Parquet
  • Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ
  • Engineering and deployment: CI/CD tooling, containerized or Kubernetes-based deployment approaches where relevant

You will also work with internal data management and platform tooling, so a practical and adaptable engineering mindset is important.

What We Are Looking For

We are looking for engineers who can deliver well-structured, reliable solutions in production and who take ownership of the quality of what they build. The role suits candidates who are technically strong, pragmatic and comfortable working in a fast-paced environment where data platforms support important business outcomes.

Stronger candidates will typically demonstrate:
  • sound judgement in technical trade-offs
  • attention to detail in data correctness and testing
  • a clear and structured approach to problem solving
  • willingness to work closely with stakeholders and partner teams
  • an interest in developing long-term expertise within the firm

About The Goldman Sachs Group, Inc

The Goldman Sachs Group, Inc. provides investment banking, securities, and investment management services, as well as financial services to corporations, financial institutions, governments, and high-net-worth individuals worldwide. Its Investment Banking segment offers financial advisory services, including advisory assignments concerning mergers and acquisitions, divestitures, corporate defense, risk management, and restructurings and spin-offs; and underwriting services comprising public offerings and private placements of a range of securities, loans, and other financial instruments, and derivative transactions. The company’s Institutional Client Services segment provides client execution services, such as fixed income, currency, and commodities client execution related to making markets in interest rate products, credit products, mortgages, currencies, and commodities; and equities related to making markets in equity products, as well as executes and clears institutional client transactions on stock, options, and futures exchanges. This segment also engages in the securities services business providing financing, securities lending, and other brokerage services to institutional clients, including hedge funds, mutual funds, pension funds, and foundations. Its Investing and Lending segment originates longer-term loans; and invests in debt securities, loans, public and private equity securities, real estate, consolidated investment entities, distressed assets, currencies, commodities, and power generation facilities. The company’s investment management segment provides investment products and services, as well as offers wealth advisory services, including portfolio management and financial counseling, and brokerage and other transaction services.

The Goldman Sachs Group, Inc. Careers

Join the prestigious team at The Goldman Sachs Group, Inc., a global leader in finance and investments, and propel your career to new heights. Our firm is renowned for its commitment to excellence, innovation, and leadership in the financial sector.

Work You’ll Do

At Goldman Sachs, you will be part of a dynamic environment that fosters growth, diversity, and professional development. Engage in transformative projects that redefine the landscape of global finance, driven by a culture of high performance and continuous improvement.

Lead with Innovation and Leadership

Step into a role where your skills will be honed and your leadership capabilities enhanced. The Goldman Sachs Group, Inc. is at the forefront of merging financial expertise with technological innovation, creating a platform for you to lead impactful initiatives.

Join Our Diverse and Inclusive Team

Diversity and inclusion are at the core of our company culture. With employees from various backgrounds, Goldman Sachs thrives on the rich ideas and perspectives that this diversity brings. Here, every team member’s contribution is valued, and every voice is heard.

Explore Job Opportunities and Internships

Whether you’re seeking full-time employment or looking into internship opportunities, Goldman Sachs offers a range of positions that cater to different skills, experiences, and career aspirations. From analyst to executive positions, discover how you can contribute to our legacy of success.

Networking and Professional Growth

Goldman Sachs is not just a workplace. It is a community where you can build lasting relationships with colleagues and industry leaders. Our networking events, mentorship programs, and professional groups foster connections that can accelerate your career trajectory.

Benefits and Career Development

Invest in your future with Goldman Sachs’ unparalleled employee benefits and career development programs. From comprehensive health benefits to personalized career coaching and leadership training, we ensure that our team is equipped for success, both professionally and personally.

Prepare for Your Future

Ready to take the next step? Prepare your resume, sharpen your interview skills, and explore the vast array of job opportunities at The Goldman Sachs Group, Inc. Our hiring process is designed to identify and nurture talent, helping you to achieve your career goals.

Stay Connected

Keep up to date with the latest from Goldman Sachs Careers by subscribing to our job alert emails. Tailor your preferences to receive updates that match your career interests and stay ahead in the competitive financial sector.

Join The Goldman Sachs Group, Inc.

Embark on a rewarding journey with The Goldman Sachs Group, Inc. where your potential is limitless. Explore positions, read about our company culture, and apply today to become part of a team that values growth, leadership, and innovation.

SEARCH GOLDMAN SACHS JOBS

READ CAREERS BLOG

At The Goldman Sachs Group, Inc., your career is just the beginning – it’s an opportunity to excel and lead in the global financial industry. Join us and make your mark!
Learn more about The Goldman Sachs Group, Inc
Size
45,100 employees
Market Cap
$115.8 billion
Industry
Finance & Insurance
Net Income
$9.4 billion
Founded
1869
5 Year Trend
+11.3%
Revenue
$53.4 billion
NASDAQ
GS
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at The Goldman Sachs Group, Inc

More Information Technology Jobs

Find similar Software Engineering - Data, Lakehouse and AI Data Platform Engineer - Associate - New York jobs:

NationwideNew York, NY