Full Job Description
Authority Brands is seeking a highly skilled principal data architect with 10+ years of relevant experience to lead a data analytics platform migration from Redshift to Databricks and lead a small team (4-5 direct reports) of data engineers & Power BI developers. This will be a muiti-year transformation and hands on experience is required to build out the Medallion architecture.
Key Responsibilities:
• Lead analytics platform migration in AWS from Redshift environment (S3, RDS, Lambda, Glue) to new Databricks environment.
• Design, build, and optimize logical data model and stand up bronze, silver and gold semantic layer in Databricks.
• Develop and optimize complex SQL and Python-based ETL processes across AWS service
• Own data modeling and schema design to support analytics, reporting, and downstream use cases.
• Partner with cross-functional teams to understand data requirements and deliver well-governed solutions.
• Establish and uphold data quality, validation, and documentation standards across pipelines and datasets.
• Monitor pipeline performance and proactively identify opportunities to improve reliability, scalability, and efficiency.
• Communicate technical concepts and data tradeoffs clearly to both technical and non-technical stakeholders.
• Support the enablement of metrics, dashboards, and reporting by providing well-modeled, trusted data foundations.
Qualifications:
• Bachelor's degree in Computer Science, Engineering, or a related field. Graduate degree in similar domain preferred.
• 10+ years of experience in data architecture & engineering or a closely related role.
• Strong SQL expertise and experience working with large datasets.
• Proficiency in Python for ETL, automation, and data pipeline development.
• Hands-on experience with Databricks and Redshift environments within AWS data services
• Experience with data modeling, version control (Git), and CI/CD practices.
• Hands-on experience leveraging LLMs such as Claude for accelerating data engineering workflows, including code generation, ETL transformations, test creation, schema documentation, and troubleshooting.
• Strong understanding of prompt design and model constraints within enterprise security guidelines
• Strong problem-solving skills and ability to work independently in a fast-moving environment.
• Excellent communication skills and comfort collaborating with cross-functional partners.
We believe our greatest assets are our employees, we offer competitive salaries and a full benefits package to include, PTO, paid holidays, 401(k) and more.