Technical Lead - Production Support (Databricks & ADF)

Anblicks

$120K — $145K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8+ years in data engineering & platform support, specifically in Azure & Databricks.
  • Strong knowledge of incident management, performance tuning, and data governance.
  • Hands-on experience with SQL, Python, Spark, and CI/CD pipelines.
  • Familiarity with monitoring tools (e.g., Azure Monitor) and automation frameworks.
  • Excellent communication and stakeholder management skills.

Responsibilities

  • Manage incident and communication processes to ensure quick resolution and stakeholder updates.
  • Proactively monitor and optimize the Data Platform's performance, cost, and reliability.
  • Enforce data quality standards and governance practices to maintain data integrity and compliance.
  • Streamline change and release management to minimize disruption during deployments.
  • Track KPIs and pursue continuous improvement to resolve recurring issues and enhance efficiency.
  • Maintain comprehensive documentation and training resources for operational knowledge management.
  • Implement automation and monitoring solutions to reduce manual intervention and support scalability.
Full Job Description
Role Overview:

We are seeking a strong Data Engineering Lead with support engagement experience to manage and enhance a Data Platform built on Azure and Databricks. This role requires a hands-on leader who can stabilize, optimize, and mature platform operations through structured processes and automation.

Key Responsibilities:
  • Incident & Communication Management - Ensure quick resolution, RCA, and transparent stakeholder updates.
  • Proactive Monitoring & Optimization - Improve performance, cost, and reliability.
  • Data Quality & Governance - Enforce data integrity, lineage, and compliance.
  • Change & Release Management - Streamline deployments and minimize disruptions.
  • Reporting & Continuous Improvement - Track KPIs, resolve recurring issues, and drive efficiency.
  • Knowledge Management - Maintain documentation, SOPs, and training for seamless operations.
  • Automation & Monitoring - Implement self-healing mechanisms and reduce manual overhead.

Qualifications:
  • 8+ years in data engineering & platform support, with expertise in Azure & Databricks.
  • Strong knowledge of incident management, performance tuning, and data governance.
  • Hands-on experience with SQL, Python, Spark, and CI/CD pipelines.
  • Familiarity with monitoring tools (Azure Monitor etc.) and automation frameworks.
  • Excellent communication and stakeholder management skills.

Similar Jobs

More Jobs at Anblicks

More Information Technology Jobs

Find similar Technical Lead - Production Support (Databricks & ADF) jobs: