7-10 years in cloud data architecture, 5 years in AWS.
Proficiency with AWS services: Glue, Redshift, Athena, and more.
Extensive experience with Databricks.
Knowledge of Alation for data governance.
Strong skills in SQL, Python, DAX, and Power Query.
Experience with SQL Server, Oracle, and PostgreSQL databases.
Proficient in Power BI, Git, and Visual Studio Code.
Responsibilities
Architect and deliver scalable, high-performance data pipelines.
Lead adoption of modern data architectures like Lakehouse and Databricks.
Strengthen data integration and governance practices.
Support analytics and AI/ML use cases.
Mentor data engineers and analysts to enhance team capabilities.
Benefits
Opportunity to work with cutting-edge cloud technologies.
Mentorship role to shape the next generation of data engineers.
Collaboration with cross-functional teams to drive business value.
Impactful role in advancing data governance and security.
Engagement with modern architectural patterns like Medallion and data mesh.
Full Job Description
We are currently looking for a Lead Analyst Data Engineer for our Houston, TX office.
POSITION DESCRIPTION:
The Lead Data Engineer is responsible for architecting and delivering scalable, high-performance data pipelines and platforms across cloud environments. This role leads the adoption of modern data architectures such as a Lakehouse and Databricks, strengthens data integration and governance, supports analytics and AI/ML use cases, and mentors data engineers and analysts to advance engineering standards and team capability.
REQUIRED SKILLS, KNOWLEDGE, AND EXPERIENCE:
7-10 years of implementation experience in cloud data architecture, with at least 5 years in AWS environments.
Proficiency in AWS services: Glue, Redshift, Athena, Lake Formation, SageMaker, Bedrock, Step Functions.
Extensive experience working with Databricks.
Working knowledge of the Alation data governance tool.
Strong skills in SQL (T-SQL), Python (PySpark/Pandas), DAX, Power Query (M), PL/SQL.
Experience with databases: SQL Server, Oracle, PostgreSQL, Azure SQL, Teradata.
Skilled in Power BI, Git, Visual Studio Code, SSMS.
Knowledge of architectural patterns: Medallion architecture, data mesh, Lakehouse, SOA data layers.
Excellent communication, collaboration, and leadership abilities.
PREFERRED SKILLS, KNOWLEDGE, AND EXPERIENCE:
AWS and Databricks certifications.
Experience leading cloud migration and data modernization initiatives.
Designing and implementing scalable data architectures in AWS and Databricks.
Managing data governance, security, and compliance in complex environments.
Mentoring junior architects and engineers.
Working with cross-functional teams to deliver business value through data.
REQUIRED EDUCATION:
Bachelor's degree in Computer Science, Data Science, Engineering, or related field
PREFERRED EDUCATION:
Masters Degree
ADDITIONAL INFORMATION:
Boardwalk Pipelines, LP, maintains a drug-free workplace and will require pre-employment drug & substance abuse testing before hiring.