The Blackstone Group LP

Lead Data Engineer

The Blackstone Group LP$135K — $160K *
Information Technology
11 - 15 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, Engineering, or related field, or equivalent experience.
  • 12-14+ years of experience in data or related engineering roles, with 8+ years focused on data engineering.
  • Advanced proficiency in SQL and/or Python for data processing, transformation, and automation.
  • Hands-on experience building and optimizing data pipelines and integration workflows.
  • Strong understanding of data modeling, performance optimization, and query tuning.
  • Experience working with cloud platforms and their data ecosystem.
  • Knowledge of ETL/ELT concepts, orchestration patterns, and automated data workflows.
  • Strong problem-solving abilities in complex or unstructured data environments.

Responsibilities

  • Design, develop, and maintain scalable data pipelines for large datasets.
  • Write efficient SQL and/or Python for data processing and integration.
  • Optimize data workflows for performance, reliability, and cost-efficiency in cloud environments.
  • Collaborate with teams to understand data requirements and deliver solutions.
  • Implement data governance and security practices across data assets.
  • Monitor data flows and troubleshoot issues to ensure data integrity.
  • Provide technical leadership and mentor junior engineers.

Benefits

  • 25% Discounted Rent at AIR communities (certain exclusions apply).
  • Medical, dental, vision, and life insurance options available, with HSA and FSA contributions.
  • Short and long-term disability paid by the company.
  • 401(K) with company contributions.
  • Paid Vacation, 14 Paid Holidays, and Paid Sick Time.
  • Tuition Assistance Program for continued education.
  • Up to 100% Reimbursement on Professional Certification/Licensing.
  • Paid parental leave of up to 16 weeks.
  • Consumer discounts on various products and services.
  • 15 hours of paid time annually for community service.
  • Opportunities for professional development and career growth.
Full Job Description
Job Description

Job Description

We are seeking a highly skilled Lead Data Engineer to join our dynamic data team. The ideal candidate has extensive experience designing, building, and optimizing modern data pipelines and cloud-based data platforms. In this role, you will help shape scalable data infrastructure that supports analytics, machine learning, and business-critical applications across the organization.

What you will do:
  • Design, develop, and maintain scalable data pipelines to ingest, transform, and deliver large and diverse datasets.
  • Write efficient, reusable SQL and/or Python for data ingestion, transformation, and integration.
  • Optimize data workflows for performance, reliability, security, and cost-efficiency in cloud environments.
  • Collaborate with data scientists, analysts, application teams, and business stakeholders to understand data requirements and deliver technical solutions.
  • Implement data governance and security practices across pipeline components and data assets.
  • Monitor data flows, troubleshoot issues, and ensure data quality, availability, and integrity.
  • Integrate data from various internal and external sources into centralized data platforms.
  • Provide technical leadership, mentor junior engineers, and support knowledge-sharing within the team.
  • Evaluate emerging tools and architectures, recommending improvements to existing systems and processes.
  • Conduct performance tuning and optimization across ingestion, transformation, and storage layers.


Qualifications

What you should have:
  • Bachelor's degree in Computer Science, Engineering, or related field, or equivalent experience.
  • 12-14+ years of experience in data or related engineering roles, with 8+ years focused on data engineering.
  • Advanced proficiency in SQL and/or Python for data processing, transformation, and automation.
  • Hands-on experience building and optimizing data pipelines and integration workflows.
  • Strong understanding of data modeling, performance optimization, and query tuning.
  • Experience working with cloud platforms and their data ecosystem.
  • Knowledge of ETL/ELT concepts, orchestration patterns, and automated data workflows.
  • Understanding of data governance, data security, and handling sensitive or regulated data (e.g., PII).
  • Experience with version control and CI/CD practices.
  • Strong problem-solving abilities with experience in complex or unstructured data environments.
  • Strong analytical and troubleshooting skills, including root-cause analysis.


Preferred qualifications:
  • Experience with distributed data processing or declarative pipeline frameworks.
  • Familiarity with cloud-native functions and workflow orchestration tools.
  • Experience with data governance frameworks, metadata management, or cataloging solutions.
  • Knowledge of columnar storage and big-data file formats.
  • Familiarity with modern table formats such as Parquet, Delta, or Iceberg.


Required Soft Skills:
  • Strong leadership and mentorship abilities, with a focus on elevating team capability and fostering knowledge sharing.
  • Strategic thinking and the ability to align engineering work with broader business objectives.
  • Effective communication skills, including the ability to translate technical concepts for non-technical audiences.
  • Collaboration-oriented mindset, thriving in cross-functional environments with product, analytics, and engineering partners.
  • Adaptability and resilience in navigating ambiguity, shifting priorities, or evolving technical landscapes.
  • Proactive initiative, consistently identifying opportunities for improvement and driving solutions forward.
  • Commitment to quality and craft, with a strong sense of ownership over system performance and reliability.
  • Growth mindset, continuously seeking new knowledge, tools, and approaches to improve team outcomes.


Additional Information

AIR offers attractive total compensation packages designed to recognize and reward performance at the individual, team and company levels. We start with a competitive base salary and add bonus opportunities and benefit choices topped off with:
  • Expected pay rate of $$135,000 - $160,000 plus annual bonus. You will be provided a pay rate that is in line with your skills and experience as they relate to the requirements of the job.
  • 25% Discounted Rent at AIR communities (certain exclusions apply, and an application is required).
  • Medical, dental, vision, and life insurance options available. HSA with company sponsored contributions, FSA (traditional and dependent care FSA).
  • Short and long-term disability paid by the company.
  • 401(K) plus company contributions.
  • Paid Vacation, 14 Paid Holidays, and Paid Sick Time.
  • Tuition Assistance Program.
  • Commuter Benefits and Pet-Insurance.
  • Up to 100% Reimbursement on Professional Certification/Licensing for Job Related Curriculums.
  • Paid parental leave of up to 16 weeks, following the birth or adoption of a child.
  • Consumer discounts from various products and services including travel planning, wireless phones, health and fitness, home appliances, and more.
  • 15 hours of paid time annually to give-back to your community.
  • Opportunities for professional development and career growth including realistic job previews, in person and virtual leadership training, and performance improvement courses.

Application Deadline: The initial deadline for applications is 6/9/2026. Applications submitted after this date may still be considered on a rolling basis until the position/program is filled. We encourage all interested candidates to apply as early as possible. If a final decision has not been made by the initial deadline, subsequent applications will be reviewed as they are received.

Videos To Watch
https://www.youtube.com/watch?v=-tnReuOmusw

About The Blackstone Group LP

Blackstone Asia is a Strategic Intelligence, Integrated Operation Agency Services and Tech Venture Group, the Information Communication and Technology (ICT) company with strong focus on strategy, communication, digital campaign, social media marketing, cyber defence, and intelligence software development based in New York, USA and Jakarta, Indonesia.

The Blackstone Group LP Careers

Join the dynamic team at The Blackstone Group LP, a premier global investment and advisory firm. With a robust portfolio of businesses and investments, there has never been a more exciting time to explore job opportunities with us. As a leader in financial innovation and asset management, we offer a platform where skills meet challenge and excellence. Work You’ll Do At The Blackstone Group LP, you will be part of a culture that thrives on leadership, professional growth, and diversity training. Our team is composed of highly skilled professionals who lead the industry not just in financial acumen but in ethical leadership and innovative solutions. Here, your career will be fueled by continuous learning and growth opportunities, supported by our substantial resources and unique position in the marketplace. Join our market-leading team to help redefine industries through strategic investment and high-caliber advisory services. At The Blackstone Group LP, you will transform businesses and drive success in a landscape ripe for innovation. Be Part of a Great Team Working with The Blackstone Group LP means being part of a global network of professionals dedicated to maintaining and extending our leadership in the financial sector. Our team benefits from unparalleled capabilities, a commitment to diversity, and a culture that prioritizes teamwork and respect. Future-Proof Your Career Embark on a career path that lets your ambition soar. The Blackstone Group LP offers a myriad of job opportunities, from internships to full-time positions, each providing a unique chance to develop your skills. With our extensive training programs and mentorship offerings, you are equipped to succeed in today’s competitive job market and beyond. Explore Discover how The Blackstone Group LP leads the way in creating value for investors and businesses worldwide. From enhancing operational efficiency to pioneering new financial models, see how your work can contribute directly to our global success. The Blackstone Group LP Employment Experience Our commitment to innovation and growth extends to our hiring practices. We seek curious, driven, and versatile team players who are ready to take on challenges and make an impact. Explore our open positions that match your skills and interests. We look for individuals eager to drive their own career forward and who are ready to make significant contributions to the financial landscape. Stay Connected Join Our Team Search for job opportunities that align with your skills and career ambitions. At The Blackstone Group LP, we value curiosity, innovation, and efficiency. Browse our current openings and find out where you fit into our exceptional team. Keep Up to Date Stay informed with the latest insights from within The Blackstone Group LP and the broader financial world. Our careers blog offers tips, industry news, and professional development resources to help you stay ahead in your career. Job Alert Emails Customize your experience by subscribing to job alerts and insider tips tailored to your preferences. Discover the exciting and rewarding career opportunities waiting for you at The Blackstone Group LP. Join The Blackstone Group LP today and be part of a team that is shaping the future of the financial industry. Your journey towards a fulfilling and impactful career starts here.
Learn more about The Blackstone Group LP
Size
3,795 employees
Market Cap
$88.7 billion
Industry
Net Income
$1 billion
Founded
1985
5 Year Trend
+34.4%
Revenue
$6.1 billion
NASDAQ

Similar Jobs

More Jobs at The Blackstone Group LP

More Information Technology Jobs

Find similar Lead Data Engineer jobs: