Job Summary
Consolidating loyalty program data following an acquisition requires merging data from multiple sources into a unified platform. This effort is part of a broader Unified Data Platform (UDP) initiative, with Databricks serving as the strategic platform for enterprise data and analytics. This is a hands-on Data Engineering role focused on building analytics-ready data products within Databricks after data has been migrated and landed in the platform.
Key Responsibilities
• Develop and maintain Silver-layer data products, transformations, tables, and materialized views within Databricks.
• Support the development of analytics-ready data products for reporting and business use cases.
• Work with Bronze, Silver, and Gold lakehouse architecture.
• Collaborate with data engineers and business stakeholders to understand and translate requirements into technical solutions.
• Support data modeling and transformation activities across the platform.
• Follow CI/CD practices and support deployment processes using Azure DevOps.
Required Qualifications
• Strong, hands-on Databricks development experience.
• Strong understanding of data modeling concepts and best practices.
• Strong Python development skills.
• Strong SQL development experience for data transformation and analytics workloads.
• Experience supporting data engineering initiatives for analytics and reporting use cases.
• Understanding of Bronze/Silver/Gold lakehouse architecture.
• CI/CD experience and familiarity with Azure DevOps deployment processes.
• Strong communication skills and the ability to collaborate effectively with technical teams and business stakeholders.
Preferred Qualifications
• Experience with Unity Catalog.
• AWS experience.
• Experience leveraging Databricks Genie or AI-assisted development tools.
• Experience gathering requirements and partnering directly with business stakeholders.
• Experience supporting large-scale analytics or customer loyalty data initiatives.
