Job Description Summary:
Design, develop, and deliver large-scale data systems, data processing, and data transformation Pipelines. Collaborate with stakeholders to understand business needs and work closely with business to deliver enterprise grade datasets that are reliable, flexible, scalable, and provide low cost of ownership. Develop optimized and scalable batch integration solutions for ABC Supply, including traditional DW workloads and nightly large extracts that are scheduled. Extract data from various sources, transform it into a usable format, and load it into Azure data lake using ADF pipelines, Databricks, Pyspark and SQL. Design and build data models - star schema, snowflake. Understand common analytical data models like Kimball. Build physical data models that align with best practice and requirements. Plan, review, and perform the implementation of database changes for integrations/DW work. Work with BI team, PO to build required tables and transform data to load into Snowflake/Dremio. Perform data management tasks. Recommend ways to improve data reliability, efficiency, and quality.
Qualifications:
Master's degree in Computer Science, IT/IS, or related field of study and two (2) years of work experience in the job offered or related occupation in which the required experience was gained. In lieu of a Master's degree in Computer Science, IT/IS, or related field of study and two (2) years of work experience in the job offered or related occupation in which the required experience was gained, employer will accept a Bachelor's degree in Computer Science, IT/IS, or related field of study and five (5) years of experience in the job offered or related occupation in which the required experience was gained. Must also have demonstrated experience in the following: Enterprise integration patterns (EIP), data warehouse modeling, ETL processes, and database management; Development and data warehouse requirements gathering, analysis and design; Cloud native Modern Data Engineering projects; Designing, building, and deploying scalable data pipelines; Python, Pyspark and Spark SQL; and Analytical data models such as Kimball.
Salary offered for the position is: 123,600.00 - $130,000.00/year.
Primary Work Location:
1 ABC Parkway, Beloit, WI 53511.
Additional Locations:
N/A
Work Shift:
Not Specified
To apply, submit a resume to https://www.abcsupply.com/, or submit a resume to https://jobcenterofwisconsin.com/, or mail resume to: ABC Supply NSC, LLC, Attn: HR, 1 ABC Parkway, Beloit, WI 53511. Must Reference Job Title: IT Data Engineer & Job Code: [Requisition Number provided by ABC Supply NSC, LLC].
Benefits may include:- Health, dental, and vision coverage - eligible after 60 days, low out of pocket
- 401(k) with generous company match - eligible after 60 days, immediately vested
- Employer paid employee assistance program
- Employer paid short term and long term disability
- Employer paid life insurance
- Flex spending
- Paid vacation
- Paid sick days
- Paid holidays
#INDABCDNP
