Managing Consultant, Databricks Engineer - Atlanta

Thought Logic Consulting

$120K — $145K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7+ years of data engineering or analytics experience, including 2 years with Databricks.
  • Proficiency in Databricks, Delta Lake, Unity Catalog, and Apache Spark.
  • Experience with orchestrating data pipelines using Airflow, dbt, and similar tools.
  • Understanding of data quality and governance best practices across enterprise data platforms.
  • Strong communication and consulting skills, capable of engaging with diverse stakeholders.

Responsibilities

  • Design scalable data solutions with Databricks Lakehouse architecture.
  • Develop batch, micro-batch, and streaming data pipelines using advanced tools.
  • Build and optimize ETL/ELT processes and orchestration workflows.
  • Implement data quality and performance optimization across platforms.
  • Establish CI/CD practices and automation for data engineering.

Benefits

  • Full-time employment with growth opportunities in a collaborative environment.
  • Access to a team of experienced professionals committed to problem-solving.
  • Opportunity to work on varied projects across multiple industries.
  • Cutting-edge technology and practices in data engineering.
  • Development of client-facing and consulting skills.
Full Job Description
Managing Consultant, Databricks Engineer - Atlanta

Department: Data Analytics

Employment Type: Full Time

Location: Atlanta

Description

Managing Consultant, Databricks Engineer - Atlanta

***Candidates must currently reside in or live within a commutable distance to the Atlanta Metro area ****

The Role

We are looking for a technically skilled and motivated Databricks Engineer with 7+ years of experience and strong hands-on Databricks expertise to join our growing Data & Analytics team.

In this role, you'll design and build modern data solutions for clients, with a focus on Databricks Lakehouse architecture, scalable data pipelines, cloud data platforms, data quality, and emerging AI-enabled engineering practices. You'll work alongside experienced architects and consultants while taking ownership of technical delivery and developing your client-facing and consulting skills.

What You'll Do
  • Design and build scalable data engineering solutions using Databricks Lakehouse, including Delta Lake, Unity Catalog, Delta Live Tables/Lakeflow Declarative Pipelines, Delta Sharing, and Uniform (Iceberg) where appropriate.
  • Develop and optimize batch, micro-batch, and streaming data pipelines using Auto Loader, Apache Spark, PySpark, SQL, and Python.
  • Build robust ETL/ELT processes, data models, and orchestration workflows using Databricks Jobs/Workflows, Airflow, dbt, and modern data engineering patterns.
  • Implement data quality, observability, governance, auditability, and performance optimization capabilities across enterprise data platforms.
  • Establish modern CI/CD and DevOps practices for data engineering, including Databricks Asset Bundles, automated testing, deployment automation, and Infrastructure as Code with tools such as Terraform.


Who You'll Work With
  • Experienced consultants, architects, and engineers focused on solving complex business and technology challenges through data.
  • Clients across industries looking to modernize data platforms, improve data accessibility and quality, and create greater value from their data.
  • Cross-functional stakeholders across technology, analytics, business operations, and leadership, requiring both technical depth and strong communication.
  • A collaborative team that values curiosity, humility, technical excellence, hands-on problem-solving, and client impact.


What You'll Bring

What You'll Bring
  • 7+ years of data engineering, analytics, or related technical experience, including at least 2 years of hands-on Databricks engineering and strong experience with Lakehouse technologies.
  • Strong hands-on skills with Databricks, Delta Lake, Unity Catalog, Lakeflow/Delta Live Tables, Apache Spark, PySpark, SQL, and Python, including scalable batch and streaming pipelines.
  • Experience with Databricks Workflows/Jobs, Auto Loader, Airflow, dbt, and/or similar orchestration and transformation technologies, plus experience with cloud data platforms such as Snowflake, Redshift, or BigQuery.
  • Understanding of enterprise data quality, governance, observability, auditability, performance optimization, CI/CD, and automated testing, with exposure to Databricks Asset Bundles and Terraform.
  • Strong consulting, communication, and problem-solving skills, with the ability to work directly with technical and non-technical stakeholders and translate business requirements into practical data solutions.


Bonus Points if You Have
  • Databricks Data Engineer Associate or Professional certification and multiple Databricks project delivery experiences.
  • Experience with modern data and cloud technologies such as Snowflake, Redshift, BigQuery, Kafka, Amazon EMR, Docker, Kubernetes, or Terraform.
  • Experience implementing enterprise data quality and governance using Great Expectations, Collibra, dbt, or Databricks-native capabilities.
  • Exposure to agentic AI and AI-powered development tools, including LangGraph, autonomous agents, GitHub Copilot, Claude Code, Cursor, Windsurf, Codex, or similar technologies.
  • Previous consulting or client-facing technical delivery experience, along with cloud or additional data engineering certifications.


Similar Jobs

More Jobs at Thought Logic Consulting

More Enterprise Technology Jobs

Find similar Managing Consultant, Databricks Engineer - Atlanta jobs: