Senior Druid Engineer

Prodapt

$120K — $150K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, Engineering, or related field, or equivalent experience.
  • 7+ years of hands-on experience administering Apache Druid in production.
  • Strong understanding of Druid architecture, including Coordinator, Overlord, Broker, and Historical.
  • Proficiency in Druid ingestion methods such as native batch, Kafka, and Hadoop-based.
  • Experience with compaction, retention policies, and lifecycle management of segments.
  • Expertise in optimizing queries for large datasets.

Responsibilities

  • Design and deploy large-scale Apache Druid clusters for petabyte-scale datasets.
  • Manage and troubleshoot Druid services to ensure optimal operation.
  • Upgrade, patch, and modernize Druid clusters regularly.
  • Monitor cluster health and performance metrics like ingestion rates and query latencies.
  • Troubleshoot various operational issues such as ingestion failures and compaction problems.
  • Optimize queries, indexing specifications, and partitioning strategies for efficiency.
  • Automate operational tasks using Ansible and Infrastructure-as-Code methodologies.

Benefits

  • Opportunity to work with cutting-edge data infrastructure technology.
  • Collaboration with skilled platform architects and cross-functional teams.
  • Focus on high availability and performance of real-time analytics solutions.
  • Engagement in operational automation and continuous platform modernization.
Full Job Description
We are looking for a skilled Apache Druid Administrator to join our Data Infrastructure team. In this role, you will be responsible for designing, deploying, and managing large-scale Apache Druid clusters that power petabyte-scale analytical workloads. You will work closely with platform architects and business teams to ensure high-availability, performance, and reliability of our real-time analytics platform.

Responsibilities

Design, deploy, administer, and optimize large-scale Apache Druid clusters supporting PB-scale datasets.
Manage and troubleshoot Druid services.
Perform cluster upgrades, patching, capacity planning, and platform modernization activities.
Monitor cluster health, ingestion performance, query latency, segment distribution, and resource utilization.
Troubleshoot ingestion failures, stuck tasks, compaction issues, retention policies, and segment management problems.
Optimize Druid queries, partitioning strategies, indexing specifications, and compaction configurations.
Configure and maintain Druid metadata stores using MySQL.
Develop operational automation using Ansible and Infrastructure-as-Code methodologies.
Create dashboards, alerts, and monitoring solutions using Grafana, Prometheus, and logging platforms.
Work with platform teams to ensure high availability, disaster recovery, backup, and security compliance.
Participate in production support, incident response, root cause analysis, and performance tuning initiatives.
Collaborate with architects and business teams to understand analytical requirements and translate them into scalable solutions.

Requirements

Bachelor's degree in Computer Science, Engineering, or a related field; OR equivalent combination of education and relevant experience.

Hands-on 7+ years of experience administering Apache Druid in production environments at scale
Strong understanding of Druid architecture: Coordinator, Overlord, Broker, Historical, MiddleManager, Router.
Proficiency in Druid ingestion specifications (native batch, Kafka, Hadoop-based)
Experience with compaction, retention policies, and segment lifecycle management
Expertise in query optimisation and partitioning strategies for large datasets

Similar Jobs

More Jobs at Prodapt

More Information Technology Jobs

Find similar Senior Druid Engineer jobs: