Deloitte

Data Engineering Manager

Deloitte$120K — $145K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8+ years of experience with AWS cloud services and data lake build & support
  • Strong experience in PySpark-based data engineering and ETL development
  • Proficient in SQL (Snowflake) for pipeline building, data analysis, and validation
  • Experience in requirements gathering and coordinating with stakeholders
  • Bachelor's degree in Computer Science, IT, or related field, or equivalent experience

Responsibilities

  • Lead solution architecture for a PySpark-based enterprise data processing framework
  • Migrate major projects from on-premises to AWS cloud data lake ecosystems
  • Design and implement metadata-driven processing framework using PySpark, Python, Databricks, and AWS
  • Build data lineage capabilities and conduct POCs in data observability
  • Develop ingestion frameworks in Talend and migrate orchestration to Apache Airflow
  • Conduct performance tuning of complex data quality rules
  • Engage in the full SDLC including client discussions, requirements gathering, and production deployment

Benefits

  • Broad range of benefits available to employees
  • Opportunities for career growth and professional development
  • Participation in a discretionary annual incentive program
  • Access to resources for interview preparation and resume development
  • Recognition of the importance of work-life balance and employee well-being
Full Job Description
Data Engineering Manager

Recruiting for this role ends on 10/1/2026

Work you'll do

A Data Engineering Manager will lead solution architecture for a PySpark-based enterprise data processing framework, improving scalability and standardizing transformation patterns across programs. Migrate major projects from on-premises platforms to AWS-based cloud data lake ecosystems, improving platform flexibility and modernization readiness. Design and implement a metadata-driven processing framework using PySpark, Python, Databricks, and AWS, reducing project go-live timelines. Build data lineage capabilities and conducted POCs in data observability, improving change impact analysis and accelerating enhancement delivery. Develop ingestion frameworks in Talend and later migrated orchestration to Apache Airflow, improving data onboarding efficiency. Performance tuning complex data quality rules, improving processing efficiency and reducing run-cost and maintenance overhead. Work across the full SDLC, including client discussions, requirements gathering, architecture design, development oversight, and production deployment. The successful candidate would possess these skills:
  • Ability to work independently and collaborate as part of a team
  • Effective written and verbal communication skills
  • Meticulous attention to detail and quality of work product
  • Ability to build and sustain professional relationships
  • Ability to lead projects or workstreams
  • Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
  • Strong interpersonal skills and professional demeanor
  • Ability to meet deadlines
  • Ability to provide clear guidance to others
The Team

AI & Data offers a full spectrum of solutions for designing, developing, and operating cutting-edge Data and AI platforms, products, insights, and services. Our offering helps clients innovate, and enhance their data, AI, and analytics capabilities, ensuring they can mature and scale effectively.

Required Qualifications
  • 8+ years of AWS cloud services and data lake build & support
  • Strong experience in PySpark-based data engineering and ETL development
  • SQL (Snowflake) pipeline build, data analysis, and data validation
  • Requirements gathering and stakeholder coordination
  • Bachelor's degree, preferably in Computer Science, Information Technology, Computer Engineering, or related IT discipline; or equivalent experience
  • Limited immigration sponsorship may be available.
  • Ability to travel 10%, on average, based on the work you do and the clients and industries/sectors you serve
Preferred
  • Strong analytical, problem-solving, communication, stakeholder-management, offshore coordination, documentation, and knowledge-transfer skills
  • Analytical ability to manage multiple projects and prioritize tasks into manageable work product
  • Can operate independently or with minimum supervision
  • Excellent Written and Communication Skills
  • Ability to deliver technical demonstrations
The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case.

You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.

Recruiting tips

From developing a stand out resume to putting your best foot forward in the interview, we want you to feel prepared and confident as you explore opportunities at Deloitte. Check out recruiting tips from Deloitte recruiters.

Benefits

At Deloitte, we know that great people make a great organization. We value our people and offer employees a broad range of benefits. Learn more about what working at Deloitte can mean for you.

About Deloitte

Deloitte is a multinational professional services network that provides audit, tax, consulting, enterprise risk and financial advisory services. The company was founded in London in 1845 and has since grown to become one of the largest professional services firms in the world. Deloitte has over 330,000 employees in more than 150 countries and territories. The company's mission is to help clients achieve their goals and make an impact that matters in their businesses and communities.
Learn more about Deloitte
Size
330,000 employees
Industry
Founded
1999

Similar Jobs

More Jobs at Deloitte

More Information Technology Jobs

Find similar Data Engineering Manager jobs: