Lead Analyst Data Engineer

Boardwalk Pipelines

$100K — $130K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7-10 years in cloud data architecture, 5 years in AWS.
  • Proficiency with AWS services: Glue, Redshift, Athena, and more.
  • Extensive experience with Databricks.
  • Knowledge of Alation for data governance.
  • Strong skills in SQL, Python, DAX, and Power Query.
  • Experience with SQL Server, Oracle, and PostgreSQL databases.
  • Proficient in Power BI, Git, and Visual Studio Code.

Responsibilities

  • Architect and deliver scalable, high-performance data pipelines.
  • Lead adoption of modern data architectures like Lakehouse and Databricks.
  • Strengthen data integration and governance practices.
  • Support analytics and AI/ML use cases.
  • Mentor data engineers and analysts to enhance team capabilities.

Benefits

  • Opportunity to work with cutting-edge cloud technologies.
  • Mentorship role to shape the next generation of data engineers.
  • Collaboration with cross-functional teams to drive business value.
  • Impactful role in advancing data governance and security.
  • Engagement with modern architectural patterns like Medallion and data mesh.
Full Job Description
We are currently looking for a Lead Analyst Data Engineer for our Houston, TX office.

POSITION DESCRIPTION:

The Lead Data Engineer is responsible for architecting and delivering scalable, high-performance data pipelines and platforms across cloud environments. This role leads the adoption of modern data architectures such as a Lakehouse and Databricks, strengthens data integration and governance, supports analytics and AI/ML use cases, and mentors data engineers and analysts to advance engineering standards and team capability.

REQUIRED SKILLS, KNOWLEDGE, AND EXPERIENCE:

  • 7-10 years of implementation experience in cloud data architecture, with at least 5 years in AWS environments.
  • Proficiency in AWS services: Glue, Redshift, Athena, Lake Formation, SageMaker, Bedrock, Step Functions.
  • Extensive experience working with Databricks.
  • Working knowledge of the Alation data governance tool.
  • Strong skills in SQL (T-SQL), Python (PySpark/Pandas), DAX, Power Query (M), PL/SQL.
  • Experience with databases: SQL Server, Oracle, PostgreSQL, Azure SQL, Teradata.
  • Skilled in Power BI, Git, Visual Studio Code, SSMS.
  • Knowledge of architectural patterns: Medallion architecture, data mesh, Lakehouse, SOA data layers.
  • Excellent communication, collaboration, and leadership abilities.


PREFERRED SKILLS, KNOWLEDGE, AND EXPERIENCE:
  • AWS and Databricks certifications.
  • Experience leading cloud migration and data modernization initiatives.
  • Designing and implementing scalable data architectures in AWS and Databricks.
  • Managing data governance, security, and compliance in complex environments.
  • Mentoring junior architects and engineers.
  • Working with cross-functional teams to deliver business value through data.


REQUIRED EDUCATION:

  • Bachelor's degree in Computer Science, Data Science, Engineering, or related field


PREFERRED EDUCATION:

  • Masters Degree

Similar Jobs

More Jobs at Boardwalk Pipelines

More Enterprise Technology Jobs

Find similar Lead Analyst Data Engineer jobs: