Lead Data Engineer

Logicbroker, Inc.

$120K — $145K *
US-AnywhereRemote in United States
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in data engineering roles.
  • Strong hands-on experience with Databricks, PySpark, and Spark SQL.
  • Proven experience implementing Medallion architecture.
  • Solid data modeling skills for analytics and reporting.
  • Experience leading small engineering teams without formal management responsibility.
  • Demonstrated ability to collaboratively refine unclear requirements.
  • Excellent written and verbal communication skills, especially in remote settings.

Responsibilities

  • Lead a small delivery team while managing complex data transformations and modeling.
  • Keep work unblocked and well-scoped to ensure consistent delivery.
  • Build and refine analytics foundations using Gold-layer data models.
  • Design and implement Medallion architecture transformations.
  • Ensure performance and consistency of Gold-layer outputs for analytics engines.
  • Enhance reliability and maintainability of existing data pipelines.
  • Collaborate with the Engineering Manager on executing the Data Warehouse Unification Plan.
  • Prepare and deliver sprint-based execution with a focus on completion.
  • Identify and surface execution risks and dependencies early.
  • Translate specifications into clear, actionable work tickets.
  • Assign tasks intelligently based on team members' skills.
  • Directly implement complex Spark and Databricks transformations as needed.
  • Review pull requests to maintain quality standards.
  • Proactively communicate progress and any blockers to stakeholders.
  • Maintain momentum with minimal process overhead.

Benefits

  • Flexible work environment with remote options.
  • Opportunity to lead a small team and influence data strategy.
  • Access to cutting-edge tools and technologies in data engineering.
  • Collaborative team culture that encourages knowledge sharing.
  • Focus on personal and professional growth through hands-on experience.
Full Job Description
Job Summary

We are hiring a Lead Data Engineer to drive delivery across our analytics and data platform initiatives. This role is a hands-on technical lead responsible for translating well-defined engineering specifications into executable work, coordinating a small team of contractors, and ensuring consistent, high-quality progress. You will partner closely with an Engineering Manager who owns architectural direction and high-level specifications. Your focus will be execution leadership: refining specifications into agile workloads, assigning work intelligently, contributing directly to complex implementations, and clearly communicating progress, risks, and clarity needs.

What You'll Do:

  • Lead a small delivery team and act as a player-coach by owning the most complex data transformations and modeling work, while reviewing and guiding contractor contributions.
  • Keep work unblocked, well-scoped, and on track to ensure consistent delivery of momentum.
  • Continue building and refining analytics foundations driven by Gold-layer data models.
  • Design and implement Medallion architecture transformations (Bronze 12 Silver 12 Gold).
  • Ensure Gold-layer outputs are well-modeled, performant, and consistently consumable by an external analytics engine.
  • Improve the reliability, clarity, and maintainability of existing pipelines.
  • Partner with the Engineering Manager to execute an approved Data Warehouse Unification Plan RFC.
  • Plan and deliver sprint-based execution, with execution as the primary focus given the RFC is already defined.
  • Work across multiple Databricks instances as part of a GDPR-first data strategy.
  • Surface execution risks, sequencing concerns, and dependencies early to support successful delivery.
  • Translate engineering specifications into clear, scoped tickets, logical sprint plans, and well-sequenced workstreams.
  • Assign work appropriately across contractors based on skill level and complexity.
  • Implement complex Spark and Databricks transformations directly as needed.
  • Review pull requests and uphold quality standards across all delivered work.
  • Communicate progress, blockers, and clarity needs clearly and proactively with stakeholders.
  • Maintain delivery momentum without unnecessary process overhead.

What We Need:

  • Strong hands-on experience with Databricks, PySpark, and Spark SQL
  • Proven experience implementing Medallion architecture
  • Solid data modeling skills, especially for analytics and reporting use cases
  • Experience leading delivery for small engineering teams (formal management not required)
  • Comfort working with partially defined requirements and refining them collaboratively
  • Clear written and verbal communication skills in a remote environment
    Nice to Have:
  • Experience supporting GDPR-compliant data strategies
  • Exposure to multi-region or multi-tenant data platforms
  • Familiarity with external analytics tools consuming warehouse data
  • Familiarity with various data flows, with sources in Azure, AWS, GCP, and others

Similar Jobs

More Jobs at Logicbroker, Inc.

  • Software Engineer
    $90K — $110K *
    Remote
    Information Technology
    Remote in United States
  • Growth Engineer
    $90K — $110K *
    Remote
    Business Services
    Remote in United States
  • Lead Data Engineer
    $120K — $145K *
    Remote
    Information Technology
    Remote in United States

More Information Technology Jobs

Find similar Lead Data Engineer jobs: