Databricks Technical Lead

Anblicks

$125K — $150K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of hands-on experience with the Databricks platform
  • Deep expertise in Apache Spark using PySpark, Scala, and SQL
  • Experience with Delta Lake, Unity Catalog, and Lakehouse architecture
  • Proficient in building data pipelines and ETL/ELT frameworks
  • Strong SQL and data modeling skills
  • Practical experience with cloud platforms like Azure or AWS.

Responsibilities

  • Design and implement end-to-end data architecture with Databricks Lakehouse platform
  • Define and establish data engineering best practices and scalable ETL/ELT pipelines
  • Architect solutions using Apache Spark and Databricks workflows
  • Implement Delta Lake for improved data reliability and governance
  • Collaborate with stakeholders to convert business needs into technical solutions
  • Optimize data pipelines for better performance and cost efficiency
  • Provide technical leadership and mentorship to data engineers and developers
  • Ensure compliance with data security and governance standards

Benefits

  • Opportunity to work in a cutting-edge cloud environment
  • Collaborative culture with a focus on mentoring
  • Engagement in high-impact projects that influence business outcomes
  • Access to continuous learning and professional development resources
  • Flexible work arrangements and supportive work-life balance.
Full Job Description
Key Responsibilities
  • Design and implement end-to-end data architecture using Databricks Lakehouse platform
  • Define data engineering best practices and build scalable ETL/ELT pipelines
  • Architect solutions leveraging Apache Spark (PySpark/Scala) and Databricks workflows
  • Implement Delta Lake for data reliability, performance, and governance
  • Collaborate with stakeholders to understand business requirements and translate them into technical solutions
  • Optimize performance, cost, and scalability of data pipelines
  • Provide technical leadership, mentoring data engineers and developers
  • Ensure data security, governance, and compliance standards are met
  • Integrate Databricks with cloud services (Azure, AWS, or GCP) and other enterprise systems
  • Support real-time and batch data processing use cases

Required Skills & Qualifications

Technical Skills
  • Strong hands-on experience with Databricks Platform
  • Expertise in Apache Spark (PySpark / Scala / SQL)
  • Experience with Delta Lake, Unity Catalog, and Lakehouse architecture
  • Proficiency in data pipelines, ETL/ELT frameworks
  • Strong experience in SQL and data modeling
  • Hands-on experience with cloud platforms:
    • Azure (ADF, ADLS, Synapse) OR
    • AWS (S3, Glue, EMR) OR

Similar Jobs

More Jobs at Anblicks

  • Databricks Technical Lead
    $125K — $150K *
    Dallas, TX 75217 (Dallas County)
    Information Technology
    In-Person
  • Sr. Data Engineer
    $125K — $150K *
    Dallas, TX 75217 (Dallas County)
    Information Technology
    In-Person
  • Data Engineering Manager
    $125K — $150K *
    Dallas, TX 75217 (Dallas County)
    Information Technology
    In-Person
  • Enterprise Architect
    $150K — $180K *
    Dallas, TX 75217 (Dallas County)
    Enterprise Technology
    In-Person
  • Lead DevOps Engineer
    $130K — $155K *
    Dallas, TX 75217 (Dallas County)
    Information Technology
    In-Person

More Information Technology Jobs

Find similar Databricks Technical Lead jobs: