Data Engineer

CosmoProf

$95K — $115K *
Enterprise Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in computer science, Information Systems, Software Engineering, Data Engineering, or a related field.
  • 3+ years of experience in Data Engineering or Software Engineering.
  • 1+ years of hands-on experience with the Databricks Lakehouse Platform.
  • Familiarity with Azure Data Lake Storage (ADLS) or Amazon S3 and similar cloud storage platforms.
  • Experience with Microsoft Azure, AWS, or Google Cloud Platform, with Azure preferred.

Responsibilities

  • Design, develop, and maintain scalable data pipelines using the Databricks Lakehouse Platform.
  • Build ETL/ELT processes utilizing Apache Spark, PySpark, Spark SQL, and Delta Lake.
  • Design and implement Medallion Architecture (Bronze, Silver, Gold).
  • Develop batch and streaming data ingestion pipelines from enterprise systems, APIs, and cloud platforms.
  • Optimize Spark jobs and Delta Lake tables for performance, scalability, and cost efficiency.

Benefits

  • Medical, dental, and vision insurance.
  • Life insurance and paid vacation/sick days.
  • Paid holidays and tuition reimbursement.
  • 401(k) plan with company match.
  • Access to in-house salon services and various food options on campus.
  • Discounts at onsite Sally Beauty and CosmoProf Professional stores.
Full Job Description
Job Description

Data Engineer

This is a hybrid position working from our Legacy West Support Center in Plano, Texas.

The Data Engineer is responsible for supporting the design, development, and maintenance of enterprise data solutions on the Data Bricks Lake House Platform. This role works closely with senior Data Engineers, Data Architects, Analytics Engineers, and business stakeholders to develop data pipelines, transform and validate data, and support reporting, analytics, artificial intelligence (AI), and machine learning (ML) initiatives. The Data Engineer I will participate in the implementation of modern cloud-based data solutions while developing technical expertise in data engineering best practices.

Responsibilities
  • Design, develop, and maintain scalable data pipelines using the Databricks Lakehouse Platform.
  • Build ETL/ELT processes utilizing Apache Spark, PySpark, Spark SQL, and Delta Lake.
  • Design and implement Medallion Architecture (Bronze, Silver, Gold).
  • Develop batch and streaming data ingestion pipelines from enterprise systems, APIs, and cloud platforms.
  • Build reusable data transformation frameworks using PySpark and SQL.
  • Optimize Spark jobs and Delta Lake tables for performance, scalability, and cost efficiency.
  • Configure and support Unity Catalog for data governance, security, and lineage.
  • Develop workflows using Databricks Workflows and Jobs.
  • Support Change Data Capture (CDC) and incremental data processing.
  • Build semantic data models supporting reporting, analytics, AI, and machine learning.
  • Implement automated testing, monitoring, and alerting for data pipelines.
  • Create technical documentation, metadata, and operational standards.
  • Research and recommend new technologies and platform enhancements

Knowledge, skills & abilities requirement
  • Bachelor's degree in computer science, Information Systems, Software Engineering, Data Engineering, or a related technical field.
  • 3+ years of experience in Data Engineering or Software Engineering.
  • 1+ years of hands-on experience with the Databricks Lakehouse Platform.
  • Experience with Azure Data Lake Storage (ADLS), Amazon S3, or similar cloud storage platforms.
  • Experience with Microsoft Azure, AWS, or Google Cloud Platform (Azure preferred).
  • Experience supporting enterprise analytics platforms such as Power BI.
  • Retail, merchandising, supply chain, or eCommerce experience preferred.

Competencies & attributes
  • Databricks Lakehouse Platform
  • Delta Lake and Delta Live Tables (DLT)
  • Unity Catalog
  • Medallion Architecture (Bronze, Silver, Gold)
  • ETL/ELT Pipeline Development
  • Data Modeling and Data Warehousing
  • Lakehouse Architecture
  • SQL Development and Performance Optimization
  • Python Programming
  • REST API and Enterprise System Integration
  • Azure Data Lake Storage (ADLS) or Cloud Object Storage
  • Azure, AWS, or Google Cloud Platform
  • Business Intelligence and Analytics Support
  • Analytical and Problem-Solving Skills
  • Strong Written and Verbal Communication
  • Cross-Functional Collaboration
  • Planning, Organization, and Time Management
  • Results-Oriented with Strong Attention to Detail


Working conditions & physical requirements

  • The work environment involves everyday risks or discomforts which require normal safety precautions typical of such places as offices, meeting and training rooms, retail stores, and residences or commercial vehicles, e.g., use of safe work practices with office equipment, avoidance of trips and falls, observance of fire regulations and traffic signals, etc. The work area is adequately lighted, heated, and ventilated.
  • The work is sedentary. Typically, the employee may sit comfortably to do the work. However, there may be some walking; standing; bending; carrying of light items such as papers, files, books, small parts; using a keyboard, driving an automobile, etc. No special physical demands are required to perform the work.

Benefits

We offer a competitive salary and outstanding benefits package that includes medical, dental, vision, life Insurance, paid vacation and sick days, paid holidays, tuition reimbursement and 401(k) with company match. In addition, associates of SBH may take advantage of our in-house salon with complementary services and a varied selection of food options at our corporate campus. Also, featured at our corporate campus, is both a Sally Beauty and CosmoProf Professional onsite store, where associates enjoy a great merchandise discount!

#LI-Hybrid

Similar Jobs

More Jobs at CosmoProf

More Enterprise Technology Jobs

Find similar Data Engineer jobs: