Data Engineering Manager

BizTek People, Inc. | APA International Placement Consultant

$120K — $150K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's degree in Computer Science or related field.
  • 10+ years of relevant experience in Data Engineering.
  • 4+ years of leadership experience managing engineering teams.
  • 4+ years experience with Hadoop and Big Data processing frameworks.
  • 2+ years building scalable, real-time cloud data lake solutions.
  • Strong proficiency in SQL and programming languages (Python, Scala, Java).
  • Experience with CI/CD processes using source control tools (GitHub).
  • Familiarity with Big Data streaming services (Kinesis, Kafka).
  • Knowledge of NoSQL data stores (HBase, DynamoDB).
  • Experience in provisioning RESTful APIs for real-time data.
  • Experience working in AWS, particularly with EMR, S3, Kinesis, Redshift, and Athena.

Responsibilities

  • Manage and lead a team of data engineers focused on scalable data solutions.
  • Participate in architecture and design discussions for processing high-volume data.
  • Guide the team in designing, implementing, and integrating new technologies.
  • Oversee the end-to-end delivery of data engineering projects, ensuring quality and efficiency.
  • Contribute to data engineering processes including ingestion, transformation, and consumption.
  • Develop reusable frameworks, automated workflows, and libraries to support analytics.
  • Collaborate effectively with stakeholders and cross-functional teams to drive data-driven decisions.

Benefits

  • Opportunity to lead a high-performing engineering team.
  • Work in a dynamic, fast-paced environment with collaborative culture.
  • Access to the latest technologies and tools in data engineering.
  • Engagement with talented professionals in the Data & Analytics field.
  • Involvement in projects that drive meaningful business insights.
Full Job Description
Job Description
We are looking for an experienced Data Engineering Manager to lead and manage a team of data engineers and analysts working on building scalable data and analytics solutions. This person will participate in architecture and design discussions, own end-to-end solution delivery, stakeholder management, partner with platform engineering, collaborate with other engineering teams, and will guide and mentor data engineers. The ideal candidate will have outstanding communication skills, proven data design and implementation capabilities, strong business acumen, and an innate drive to deliver results. The person in this role will be technically proficient and excel at collaborating with engineers, analysts, and stakeholders. He/she will be a self-starter, comfortable with ambiguity, and will enjoy working in a fast-paced dynamic environment.

WHAT WILL YOU WORK ON

In this role, you will manage an engineering team focused on building and delivering scalable data and analytics solutions in our Direct, Supply Chain, and Commercial space. The team will design, implement and integrate new technologies and evolve data and analytics products. You will be contributing to all aspects of data engineering from ingestion, transformation, and consumption in addition to designing and building test-driven development, reusable frameworks, automated workflows, and libraries at scale to support analytics products. You will also participate in architecture and design discussions to process and store high-volume data sets.

WHO WILL YOU WORK WITH

This role is part of the North America Data & Analytics Organization and you will work with world-class talent in the field of Data Engineering with a goal of better business insights and driving data-driven decisions across the organization. You'll be working closely with Internal stakeholders, Product Owners, Engineering Leaders, Data Analysts, Big Data Leads, and Engineers. One of our maxims is "Win as a Team" and you will be working in a very collaborative environment and will find success in teamwork, a positive attitude, and hard work.

Requirements

WHAT YOU BRING

  • Bachelor's or Master's degreein Computer Science or related field
  • 10+ years relevant workexperience in the Data Engineering field
  • 4+ years experience inleading and managing engineering teams
  • 4+ years experience workingwith Hadoop and Big Data processing frameworks (Spark, Hive, Nifi,Spark-Streaming, Flink, etc.)
  • 2+ years experience buildingscalable, real-time and high-performance cloud data lake solutions
  • Strong experience withrelational SQL and programming languages such as Python, Scala, or Java
  • Experience with sourcecontrol tools such as GitHub and related CI/CD processes
  • Experience working with BigData streaming services such as Kinesis, Kafka, etc.
  • Experience working with NoSQLdata stores such as HBase, DynamoDB, etc.
  • Experience provisioningRESTful API's to enable real-time data consumption
  • Experience working in AWSenvironment primarily EMR, S3, Kinesis, Redshift, Athena, etc
  • Experience with datawarehouses/RDBMS like Snowflake & Teradata
  • Experience with workflowscheduling tools like Airflow
  • Strong understanding ofalgorithms, data structures, data architecture, and technical designs.
  • Has a strong problem solvingand analytical approach.

Similar Jobs

More Jobs at BizTek People, Inc. | APA International Placement Consultant

More Enterprise Technology Jobs

Find similar Data Engineering Manager jobs: