8+ years of experience in Data Engineering or Business Intelligence
Proficient in Azure Databricks and Azure Data Factory (ADF)
Experience with cloud environments, specifically Azure or AWS
Strong background in data pipeline architecture and CI/CD methodologies
Expertise in SQL, including ETL and SSIS packages
Familiarity with automation using Python (PySpark) or Scala
Responsibilities
Design and build enterprise data architecture and pipelines in the cloud
Maintain and automate data processes to ensure efficiency
Collaborate with teams on data reporting and new development initiatives
Assess and resolve ambiguous data challenges independently
Deploy data pipelines and manage data mapping effectively
Benefits
Opportunity to work in a growing team environment
Engagement in innovative data initiatives
Flexible work arrangements
Professional development opportunities
Collaborative culture that values input and success metrics
Full Job Description
Title: Senior Data Engineer
Location: Coppell, TX
Salary Range: $120K-$140K
We are looking to bring on a Senior Data Engineer to our team due to growth. What we need is someone who comes 8+ years of experience in the Data Engineering space who specializes in Microsoft Azure and Databricks. This person will be a part of multiple initiatives for the "New Development" and "Data Reporting" teams but will be primarily tasked with designing, building, maintaining, and automating their enterprise data architecture/pipelines within the cloud.
Technology-wise we are needing to come with skills in Azure Databricks (5+ years), cloud-based environment (Azure and/or AWS), Azure DevOps (ADO), SQL (ETL, SSIS packages), and PySpark or Scala automation. Architecture experience in building pipelines, data modeling, data pipeline deployment, data mapping, etc.
Personality-wise we need an Engineer who is able to assess, breakdown, and complete tasks without them needing too much direction. There is a lot of ambiguous data that they need to help with define, uncover, and resolve. Most of the work will be done from a solo capacity but collaboration for the data and what defines success is crucial.
Top Skills:
-8+ Years of Data Engineer/Business Intelligence
-Databricks and Azure Data Factory (ADF) (Need version on resume): *Most updates is Unity Catalog for Databricks*
-Cloud-based environments (Azure or AWS)
-Data Pipeline Architecture and CI/CD methodology
-SQL
-Automation (Python (PySpark), Scala)
About Addison Group
Addison Group is a professional staffing and consulting firm that provides services in the areas of information technology, finance and accounting, healthcare, human resources, and administration. The company was founded in 1999 and is headquartered in Chicago, Illinois. Addison Group has over 2500 employees and operates in 22 locations across the United States. The company has been recognized as one of the fastest-growing private staffing firms in the United States by Inc. Magazine.
