This position is not eligible for immigration sponsorship, e.g., H-1B, TN, etc. Please do not apply if you will need immigration sponsorship for a work visa now or in the future, including sponsorship for H-1B, TN, etc., now or in the future. We are unable to hire individuals with CPT, OPT, or STEM OPT for this position as the position is not eligible for participation in the H-1B lottery program and is not eligible for current or future immigration sponsorship for a work visa.Location: This is a hybrid (virtual/onsite) position with required onsite days on Monday, Tuesday and Thursday assigned to One Energy Plaza located in Jackson, MI. The selected candidate must be within a commutable distance or willing to relocate (relocation package is available for those that qualify).
General Summary of Job ResponsibilitiesThe Senior Data Engineer works independently with little direction or oversight and will be responsible for partnering with various analytics team and business partners throughout the enterprise to collect data requirements and design and build data pipelines/architecture as per IT best practices defined. Creating a data warehouse, design-related extraction, loading data functions, testing designs, data modeling, and ensure the smooth running of applications. Building analytic tools, assembling and cleaning BIG data, designing and building ETL using various technology languages, creating data visualization, assembling large complex data and identifying and improving internal process to automate manual data wrangling, optimizing performance, and improve data quality.
Essential Duties and Responsibilities- Provide technical leadership for incident management and direct technical consulting and support for current applications/solutions.
- Assemble and clean BIG data; complex data sets including various data sources to meet functional business requirements for medium to large enhancements and IT Projects or Technical Modeling Projects.
- Capture/evaluate requirements from the data architect or business partner.
- Consider development alternatives, and establishes timelines.
- Build analytic tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
- Work with Various Stakeholders/IT to design and build efficient data pipelines for medium to large enhancements and IT Projects or Technical Modeling Projects.
- Design and create complex data visualizations for customer insight, operational efficiency and other key business performance metrics using various reporting tools.
- Prepare, review and/or approve artifacts to support solutions as well as to document activities.
- Provide technical expertise for medium to large enhancements and IT Projects or Technical Modeling Projects in the areas of solution alternatives, design, testing and documentation.
- Identify and improve internal process to automate manual data wrangling, optimizing performance, and improve data quality for medium to large enhancements and IT Projects or Technical Modeling Projects.
- Other duties as assigned or may be necessary.
Knowledge/Skills/Abilities- Understanding of data test methodologies and testing tools
- Understanding of database management principles and methodologies, including data structures, data modeling, data warehousing, and transaction processing
- Knowledge of data design principles, methods, and approaches, applying systems engineering concepts such as: data structured design, supportability, survivability, reliability, scalability, and maintainability
- Must have excellent verbal and written communication skills and be able to work with all levels of the organization
- Proficient in establishing and maintaining good working relationships (business and IT teams)
- Knowledge of project planning/full lifecycle delivery using Agile framework
- Ability to work effectively with contract employees and vendors
- Knowledge of change and release tools and processes utilized to implement solutions across multiple teams and technologies.
Education/Experience- Bachelor's Degree in Data Engineering, Computer Science, Engineering, Data Sciences or related field with four (4) or more years in Data Engineer or Software Engineer and experience as Intermediate Data Engineer. Advanced Analytic tool build, data architecture/design, user requirements definition, build BIG data pipeline, understanding of ETL tool extraction, basic data testing aptitude, and understanding of analytic tool deployment processes and best practices.
- [OR] Associate Degree in Data Engineering, Computer Science, Engineering, Data Sciences or related field with six (6) or more years in Data Engineer or Software Engineer and experience as Intermediate Data Engineer. Advanced Analytic tool build, data architecture/design, user requirements definition, build BIG data pipeline, understanding of ETL tool extraction, basic data testing aptitude, and understanding of analytic tool deployment processes and best practices.
- [OR] High School Diploma or GED with eight (8) or more years in Data Engineer or Software Engineer and experience as Intermediate Data Engineer. Advanced Analytic tool build, data architecture/design, user requirements definition, build BIG data pipeline, understanding of ETL tool extraction, basic data testing aptitude, and understanding of analytic tool deployment processes and best practices.
Preferred Experience- Demonstrated experience designing and supporting scalable enterprise data platforms using Databricks and Lakehouse Architecture.
- Experience leveraging Delta Lake, Delta Live Tables (DLT), Structured Streaming, Unity Catalog, Databricks Workflows, and Databricks Asset Bundles.
- Strong understanding of Medallion Architecture and dimensional data modeling, including star schema design.
- Experience establishing data quality, governance, and validation standards.
- Experience with CI/CD automation and DevOps methodologies for data engineering and analytics solutions.
