Lead Analyst Data Engineer

Boardwalk Pipelines

$120K — $145K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7-10 years of cloud data architecture experience, including 5 years in AWS
  • Proficient in AWS services like Glue, Redshift, and SageMaker
  • Experienced with Databricks for data processing and analytics
  • Familiar with the Alation data governance tool
  • Strong SQL, Python, and DAX skills
  • Knowledgeable in various databases such as SQL Server and Oracle
  • Proficient in using Power BI and Git for data visualization and version control

Responsibilities

  • Architect and deliver scalable data pipelines across cloud platforms
  • Lead the adoption of modern data architectures like Lakehouse and Databricks
  • Enhance data integration and governance processes
  • Support analytics and AI/ML use cases effectively
  • Mentor data engineers and analysts to elevate engineering standards

Benefits

  • Opportunity to lead innovative data projects
  • Access to advanced cloud technologies and tools
  • Collaboration with cross-functional teams to drive impactful data solutions
  • Mentorship opportunities for professional development
  • Dynamic work environment in a prominent tech hub like Houston
Full Job Description
We are currently looking for an Lead Analyst Data Engineer for our Houston, TX office. POSITION DESCRIPTION: The Lead Data Engineer is responsible for architecting and delivering scalable, high-performance data pipelines and platforms across cloud environments. This role leads the adoption of modern data architectures such as a Lakehouse and Databricks, strengthens data integration and governance, supports analytics and AI/ML use cases, and mentors data engineers and analysts to advance engineering standards and team capability. REQUIRED SKILLS, KNOWLEDGE, AND EXPERIENCE:
  • 7-10 years of implementation experience in cloud data architecture, with at least 5 years in AWS environments.
  • Proficiency in AWS services: Glue, Redshift, Athena, Lake Formation, SageMaker, Bedrock, Step Functions.
  • Extensive experience working with Databricks.
  • Working knowledge of the Alation data governance tool.
  • Strong skills in SQL (T-SQL), Python (PySpark/Pandas), DAX, Power Query (M), PL/SQL.
  • Experience with databases: SQL Server, Oracle, PostgreSQL, Azure SQL, Teradata.
  • Skilled in Power BI, Git, Visual Studio Code, SSMS.
  • Knowledge of architectural patterns: Medallion architecture, data mesh, Lakehouse, SOA data layers.
  • Excellent communication, collaboration, and leadership abilities.
PREFERRED SKILLS, KNOWLEDGE, AND EXPERIENCE:
  • AWS and Databricks certifications.
  • Experience leading cloud migration and data modernization initiatives.
  • Designing and implementing scalable data architectures in AWS and Databricks.
  • Managing data governance, security, and compliance in complex environments.
  • Mentoring junior architects and engineers.
  • Working with cross-functional teams to deliver business value through data.
REQUIRED EDUCATION:
  • Bachelor's degree in Computer Science, Data Science, Engineering, or related field
PREFERRED EDUCATION:
  • Master's Degree

Similar Jobs

More Jobs at Boardwalk Pipelines

More Information Technology Jobs

Find similar Lead Analyst Data Engineer jobs: