Bachelor's degree in Computer Science, Data Engineering, or related field, or equivalent experience.
2-4 years of experience in Data Engineering or related roles.
Strong experience in data pipeline development and ETL/ELT concepts.
Advanced SQL skills for query optimization and data validation.
Hands-on experience with Databricks and cloud technologies.
Responsibilities
Design and optimize scalable data pipelines using Databricks and cloud technologies.
Build data ingestion processes from various internal and external sources.
Transform and prepare data for reporting and analytics.
Monitor and troubleshoot data pipelines for reliability and efficiency.
Collaborate with stakeholders to deliver scalable data solutions that support business objectives.
Identify opportunities for improving data integration and operational efficiency.
Develop and maintain data solutions adhering to security and compliance standards.
Benefits
Competitive Health, Dental & Vision Insurance
Yearly vacation bank
Retirement saving plans
Employee discounts
Opportunities for career growth
Full Job Description
The Data Engineer is responsible for developing, and supporting scalable data solutions that enable reporting, analytics and automation, in support of business decision-making. The role builds and optimizes data pipelines within Databricks, ensuring the availability, reliability, and integrity of data required to support operational, analytical, and AI-driven initiatives. The role partners with business and technical stakeholders to translate reporting, analytics, automation, and data requirements into scalable and reliable data solutions.
Here are the daily responsibilities for a Data Engineer:
Data Engineering & Integration
Design, develop, maintain, and optimize scalable data pipelines, integrations, and data solutions using Databricks and cloud technologies.
Build and support data ingestion processes from enterprise applications, databases, APIs, files, and other internal and external data sources.
Transform, cleanse, validate, and prepare data to support reporting, analytics, operational, and advanced analytical use cases.
Monitor and troubleshoot data pipelines and workloads to ensure reliable, efficient, and available data processing.
Data Management & Quality
Ensure data quality, integrity, consistency, security, and accessibility through established data management, governance, metadata, and documentation practices, including maintaining documentation for data pipelines, integrations, transformations, and datasets.
Analytics & Business Support
Collaborate with business, analytics, and technical stakeholders to understand requirements and deliver scalable data solutions that support reporting, analytics, automation, and decision-making.
Support the integration and management of data from ERP, CRM, Engineering, and other operational systems.
Provide recommendations on data integration, reporting, data quality, and technical solutions that support business objectives.
Continuous Improvement & Innovation
Identify and implement opportunities to improve data integration, automation, platform performance, and operational efficiency.
Support advanced analytics, artificial intelligence, and machine learning initiatives by enabling reliable, accessible, and well-structured data environments.
Development Standards, Security & Compliance
Develop, test, deploy, and maintain data solutions using established development, change management, and CI/CD practices.
Adhere to cybersecurity, privacy, governance, audit, and compliance requirements while ensuring solution reliability and maintainability.
Here is what is required to succeed:
Bachelor's degree in Computer Science, Data Engineering, Information Systems, Analytics, Software Engineering, or a related quantitative field, or an equivalent combination of education and relevant experience.
2-4 years of experience in a Data Engineer, Analytics Engineer, Data Analytics, Business Intelligence, or related role.
Technical Skills & Knowledge
Strong experience in data pipeline development and a solid understanding of ETL/ELT concepts, data integration principles, and data transformation workflows.
Advanced working knowledge of SQL, including query authoring, optimization, data validation, and performance troubleshooting.
Experience working with relational and NoSQL databases.
Hands-on experience with data warehouses, data lakes, and/or Lakehouse architectures.
Proficiency in ingesting, transforming, and processing structured, semi-structured, and unstructured data into analytics-ready datasets using Polars, Apache Spark, or similar frameworks.
Experience with Databricks, Delta Lake, and Medallion Architecture.
Experience with data pipeline and workflow orchestration tools.
Experience integrating data from enterprise applications, APIs, databases, cloud platforms, and file-based sources.
Experience with Microsoft Azure cloud services, including Azure Data Factory, Azure Synapse Analytics, Microsoft Fabric, Azure Storage, or similar cloud-based platforms.
Experience with Azure DevOps, repositories, and Git-based source control and collaborative development practices.
Experience with object-oriented and scripting languages such as Python, Java, Scala, or C++.
Understanding of data warehousing concepts, dimensional modelling, star schemas, and analytics data structures.
Knowledge of data quality, data governance, metadata management, and data documentation best practices.
Understanding of data security, access controls, and data protection practices within cloud-based environments.
Knowledge of CI/CD concepts, deployment practices, and development lifecycle management is considered an asset.
Experience working within Agile, Scrum, or iterative development environments is considered an asset.
Analytics & Data Management
Experience supporting AI/ML, advanced analytics, or data science initiatives; knowledge of machine learning concepts and models is considered an asset.
Ability to analyze business and technical requirements and translate them into scalable and reliable data solutions.
Ability to collaborate with business stakeholders to gather requirements and translate analytical needs into technical solutions.
Demonstrated attention to detail and commitment to data accuracy, integrity, reliability, and security.
Professional Competencies
Strong analytical and problem-solving skills with the ability to identify root causes and develop effective technical solutions.
Strong project management, prioritization, and organizational skills.
Strong documentation, reporting, and data visualization skills.
Ability to communicate data concepts effectively to both technical and non-technical audiences.
Strong collaboration skills with the ability to work effectively across Information Technology, Digital, Analytics, Operations, Engineering, Supply Chain, Finance, and other business functions.
Demonstrated initiative, accountability, continuous learning, and commitment to continuous improvement.
Ability to exercise sound judgment and make independent technical decisions within established standards, policies, and procedures.
If your experience aligns with the qualifications for this role, we encourage you to apply - we'd like to hear from you!
We provide comprehensive benefits for you and your family, as well as ample opportunities to grow your career.