ELK Observability Lead

Prophecy Technologies

$120K — $150K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 10+ years of experience in observability or related fields
  • Expert level proficiency in Elasticsearch
  • Strong understanding of distributed architecture and cluster design
  • Experience with search and index optimization techniques
  • Knowledge of performance tuning and scaling strategies
  • Familiarity with ILM, data streams, and sharding strategies

Responsibilities

  • Lead the design and implementation of the ELK Stack for comprehensive observability
  • Own and execute the observability strategy in collaboration with cross-functional teams
  • Drive optimization and reliability for high-volume data ingestion and retrieval
  • Oversee development of data ingestion pipelines for robust data flow
  • Deliver advanced analytics and visualizations in Kibana
  • Establish best practices for security, governance, and compliance in the ELK ecosystem
  • Act as a technical leader and mentor within the observability domain
  • Collaborate with DevOps, SRE, and application teams to ensure seamless observability integration

Benefits

  • Opportunity for technical leadership and mentorship
  • Engagement in cutting-edge observability practices
  • Collaborative environment with cross-functional teams
  • Possibility to drive major enhancements in enterprise observability strategy
  • Focus on performance optimization in high-demand environments
Full Job Description
Role Overview:

The ELK Observability Lead will be responsible for spearheading the design, implementation, and continuous enhancement of the ELK Stack (Elasticsearch, Logstash, Kibana) to provide comprehensive enterprise-wide observability, logging, and monitoring capabilities. This role involves owning the observability strategy and collaborating with cross-functional teams to translate operational requirements into scalable dashboards, alerts, and reporting solutions.

Key Responsibilities:
  • Lead the design, implementation, and ongoing enhancement of the ELK Stack (Elasticsearch, Logstash, Kibana) to deliver enterprise-wide observability, logging, and monitoring capabilities.
  • Own the observability strategy by collaborating with cross-functional teams to translate business and operational requirements into scalable dashboards, alerts, and reporting solutions for diverse stakeholders.
  • Drive performance optimization and reliability of the ELK platform, including proactive monitoring, troubleshooting, and fine-tuning of Elasticsearch clusters for high-volume data ingestion, storage, and retrieval.
  • Oversee the development and governance of data ingestion pipelines using Logstash and other tools, ensuring robust, scalable, and reliable data flow from multiple heterogeneous sources.
  • Enable advanced observability use cases by delivering meaningful analytics and intuitive data visualizations in Kibana to support IT operations, incident response, and business insights.
  • Establish and enforce best practices for security, data governance, access control, and compliance within the ELK ecosystem.
  • Act as a technical leader and SME for observability, mentoring team members, driving capability building, and providing guidance on ELK best practices and modern observability approaches.
  • Work closely with DevOps, SRE, and application teams to integrate observability into CI/CD pipelines and ensure end-to-end visibility across systems and services.

Required Skills:
  • Elasticsearch (Expert level)
  • Distributed Architecture & Cluster Design
  • Search & Index Optimization (Query DSL, Aggregations)
  • Performance Tuning & Scaling
  • ILM, Data Streams, Sharding Strategy
  • Digital : Elastic Search

Qualifications:
  • 10+ years of experience

Preferred Skills:
  • Prior experience in AIOps, ITOM, or observability solutions.
  • Familiarity with scripting and automation (e.g., Python, Bash).
  • Knowledge of infrastructure-as-code tools like Terraform or Ansible.

Similar Jobs

More Jobs at Prophecy Technologies

More Information Technology Jobs

Find similar ELK Observability Lead jobs: