Sr. Lead Data Engineer

Overview

The Professional/Individual Contributor Staff member is responsible for performing work responsibilities, building relationships, and sharing expertise and experience as he/she contributes to specific bodies of work, builds connections, and optimizes performance.  As a Senior Lead Data Engineer, you will be responsible for leading complex project work as a part of a larger cross-functional team in support of Supply Chain. Sr. Lead Data Engineers typically design, implement, maintain, and optimize necessary analytics infrastructure on technically complex projects, focusing on developing solutions to data modeling and/or analytics technology needs. You must have a general understand of Supply Chain operations and be able to quickly develop mastery of the needed subject area across Supply Chain.  Our Senior Lead Data Engineers work with wide latitude for action or decisions on projects that are more complex and cross functional in nature. They serve as technical anchors within one or more product areas or platform capabilities, applying adv anced knowledge to outcomes of complexity and providing technical leadership and consultation to peer engineers on the design patterns, modeling standards, and testing frameworks that keep data products consistent, scalable, and aligned to enterprise standards. They act as a subject-matter-expert and resource on data and/or analytics technology, and they may represent SCDA in external conversations. They also assist with the selection or oversight of outside vendor partners. They are expected to influence the proje ct execution of IT and analyst teams. Successful candidates for this role must have strong analytical and data modeling skills, a deep understanding of database technology and data use within analytic platforms, and they must have strong programming skills with SQL and Python.  We expect our Senior Lead Data Engineers to have demonstrated fluency in both the technology language of IT and the analyst language of Supply Chain. They bring deep experience developing and implementing data models for analytic use and strong proficiency with cloud database architecture. They apply seasoned judgment to ambiguous, multi-source data problems, balancing performance, cost, and maintainability, and they work steadfastly with cross-functional partners to create impactful change. 

Responsibilities

• Exhibits wide latitude in aligning Supply Chain stakeholders and IT to translate business logic into scalable data and analytic solutions on complex projects.       • Develops ETL pipelines for Supply Chain consumption, establishing patterns for repeatable, scalable ETL work that others can leverage in their work.  • Develops tool, data, and analytics best practices for SCDA and advises on their integration into operational practices.  • Designs specific tool implementations, understanding Databricks, DBT, and cloud compute performance requirements and expectations.  • Helps design patterns for efficient use of cloud compute resources.

• Drives architecture decisions and establishes the technical approach for the product area, balancing performance, cost, and maintainability on ambiguous, multisource data problems.

• Defines design patterns, modeling standards, and testing frameworks for the product area, and leads design reviews to guide engineering work across the team.  • Provides technical direction and mentorship to peer engineers, building capability across the product area without requiring managerial oversight.  • Owns and is accountable for data model and code quality and any relevant documentation.  • Acts as a technical anchor for one or more product areas or platform capabilities, owning end• Implements data governance and master data management principles across specific project execution.  • Act as a subject matter expert and resource on data and/or analytics technology issues for the larger SCDA community.  • Drives complex projects to success and enables others to own the impact.  

• Manages any needed maintenance and quality control on data pipelines or data products they have built which are actively in use. 

Required Qualifications (Knowledge, Skills, & Abilities)

• Has strong analytical and data modeling skills  • Has a deep understanding of cloud database technology  • Has a deep understanding of analytic platform data use  • Has strong programming skills in SQL and Python • Has experience developing and implementing data models for analytic use  • Has moderate experience with cloud database architecture  • Has the skill to partner with cross functional teams using strong written and verbal communication  • Fast learner and proven problem solver  • Keen eye for system thinking and process design, especially with respect to scalability and automation  • Keen eye for detail and thoughtful investigation of data  • Has a steadfast focus on creating impactful change    

Preferred Qualifications (Knowledge, Skills, & Abilities)

• Has some experience using the AWS big data technology stack   • Has extensive experience with Databricks, dbt, Snowflake, or similar distributed platforms   • Has extensive experience with Tableau or similar data visualization tools   • Has some experience implementing data governance principles   • Has experience defining engineering standards, design patterns, or leading design reviews for peer engineers within a product area or discipline 

Required Years of Experience5 Preferred Years of Experience10 Travel Requirements10% Required Level of EducationBachelor's Degree Preferred Level of EducationMaster's Degree Major/ConcentrationMIS, Decision Sciences, Engineering, Business Analytics, Computer Science or other similar fields Preferred Major/ConcentrationMIS, Decision Sciences, Engineering, Business Analytics, Computer Science or other similar fields Relocation Assistance ProvidedNo