IT Data Engineer

ABC Supply Co. • $123K — $130K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Master's degree in Computer Science, IT/IS, or related field plus 2 years of relevant experience, or Bachelor's degree with 5 years of experience.
  • Strong expertise in Enterprise integration patterns (EIP) and data warehouse modeling.
  • Proficiency in ETL processes and database management.
  • Experience with cloud-native Modern Data Engineering projects.
  • Skilled in Python, Pyspark, and Spark SQL.
  • Familiarity with analytical data models, specifically Kimball.

Responsibilities

  • Design and develop robust large-scale data systems and processing pipelines.
  • Collaborate with stakeholders to gather business requirements.
  • Create optimized batch integration solutions and manage nightly data extracts.
  • Extract, transform, and load data into Azure data lake using ADF and Databricks.
  • Develop physical data models that adhere to best practices and project requirements.
  • Plan and implement changes for database integrations and data warehouse work.
  • Work with BI teams to prepare and transform data for Snowflake/Dremio.

Benefits

  • Health, dental, and vision coverage eligible after 60 days with low out-of-pocket costs.
  • 401(k) with a generous company match and immediate vesting after 60 days.
  • Employer-paid employee assistance program for personal support.
  • Employer-paid short and long-term disability coverage.
  • Employer-paid life insurance for financial security.
  • Flexible spending options for medical expenses.
  • Paid vacation, sick days, and holidays to encourage work-life balance.
Full Job Description
Job Description Summary:

Design, develop, and deliver large-scale data systems, data processing, and data transformation Pipelines. Collaborate with stakeholders to understand business needs and work closely with business to deliver enterprise grade datasets that are reliable, flexible, scalable, and provide low cost of ownership. Develop optimized and scalable batch integration solutions for ABC Supply, including traditional DW workloads and nightly large extracts that are scheduled. Extract data from various sources, transform it into a usable format, and load it into Azure data lake using ADF pipelines, Databricks, Pyspark and SQL. Design and build data models - star schema, snowflake. Understand common analytical data models like Kimball. Build physical data models that align with best practice and requirements. Plan, review, and perform the implementation of database changes for integrations/DW work. Work with BI team, PO to build required tables and transform data to load into Snowflake/Dremio. Perform data management tasks. Recommend ways to improve data reliability, efficiency, and quality.

Qualifications:

Master's degree in Computer Science, IT/IS, or related field of study and two (2) years of work experience in the job offered or related occupation in which the required experience was gained. In lieu of a Master's degree in Computer Science, IT/IS, or related field of study and two (2) years of work experience in the job offered or related occupation in which the required experience was gained, employer will accept a Bachelor's degree in Computer Science, IT/IS, or related field of study and five (5) years of experience in the job offered or related occupation in which the required experience was gained. Must also have demonstrated experience in the following: Enterprise integration patterns (EIP), data warehouse modeling, ETL processes, and database management; Development and data warehouse requirements gathering, analysis and design; Cloud native Modern Data Engineering projects; Designing, building, and deploying scalable data pipelines; Python, Pyspark and Spark SQL; and Analytical data models such as Kimball.

Salary offered for the position is: 123,600.00 - $130,000.00/year.

Primary Work Location:

1 ABC Parkway, Beloit, WI 53511.

Additional Locations:

N/A

Work Shift:

Not Specified

To apply, submit a resume to https://www.abcsupply.com/, or submit a resume to https://jobcenterofwisconsin.com/, or mail resume to: ABC Supply NSC, LLC, Attn: HR, 1 ABC Parkway, Beloit, WI 53511. Must Reference Job Title: IT Data Engineer & Job Code: [Requisition Number provided by ABC Supply NSC, LLC].

Benefits may include:
  • Health, dental, and vision coverage - eligible after 60 days, low out of pocket
  • 401(k) with generous company match - eligible after 60 days, immediately vested
  • Employer paid employee assistance program
  • Employer paid short term and long term disability
  • Employer paid life insurance
  • Flex spending
  • Paid vacation
  • Paid sick days
  • Paid holidays


#INDABCDNP

Similar Jobs

More Jobs at ABC Supply Co.

More Information Technology Jobs

Find similar IT Data Engineer jobs: