8+ years of experience in Data Engineering or Business Intelligence
Proficient in Microsoft Azure and Databricks (5+ years)
Experience with cloud environments (Azure or AWS)
Strong skills in SQL, ETL, and SSIS packages
Familiarity with Azure DevOps (ADO) and CI/CD methodologies
Knowledge of data pipeline architecture and automation using Python (PySpark) or Scala
Ability to work independently and collaboratively in ambiguous situations
Responsibilities
Design and build enterprise data architecture and pipelines in the cloud
Maintain and automate data processes for the New Development and Data Reporting teams
Assess and resolve ambiguous data issues independently
Collaborate with team members to define success metrics
Deploy data pipelines and manage data mapping
Utilize Azure Databricks and Azure Data Factory for data management
Implement CI/CD practices for data pipeline development
Benefits
Opportunity to work in a growing team environment
Engagement in multiple initiatives across departments
Focus on innovative data solutions and architecture
Chance to work with cutting-edge technologies like Azure and Databricks
Flexible work arrangements with a focus on collaboration
Full Job Description
Title: Senior Data Engineer
Location: Coppell, TX
Salary Range: $120K-$140K
We are looking to bring on a Senior Data Engineer to our team due to growth. What we need is someone who comes 8+ years of experience in the Data Engineering space who specializes in Microsoft Azure and Databricks. This person will be a part of multiple initiatives for the "New Development" and "Data Reporting" teams but will be primarily tasked with designing, building, maintaining, and automating their enterprise data architecture/pipelines within the cloud.
Technology-wise we are needing to come with skills in Azure Databricks (5+ years), cloud-based environment (Azure and/or AWS), Azure DevOps (ADO), SQL (ETL, SSIS packages), and PySpark or Scala automation. Architecture experience in building pipelines, data modeling, data pipeline deployment, data mapping, etc.
Personality-wise we need an Engineer who is able to assess, breakdown, and complete tasks without them needing too much direction. There is a lot of ambiguous data that they need to help with define, uncover, and resolve. Most of the work will be done from a solo capacity but collaboration for the data and what defines success is crucial.
Top Skills:
-8+ Years of Data Engineer/Business Intelligence
-Databricks and Azure Data Factory (ADF) (Need version on resume): *Most updates is Unity Catalog for Databricks*
-Cloud-based environments (Azure or AWS)
-Data Pipeline Architecture and CI/CD methodology
-SQL
-Automation (Python (PySpark), Scala)
About Addison Group
Addison Group is a professional staffing and consulting firm that provides services in the areas of information technology, finance and accounting, healthcare, human resources, and administration. The company was founded in 1999 and is headquartered in Chicago, Illinois. Addison Group has over 2500 employees and operates in 22 locations across the United States. The company has been recognized as one of the fastest-growing private staffing firms in the United States by Inc. Magazine.
