Technical Degree in Information Technology required
5+ years of experience with Elastic Cloud and AWS Managed Prometheus
Proficient in installation, configuration, and management of data pipelines and Elastic clusters
Skilled in Python, Bash, PowerShell, and Painless scripting languages
Extensive knowledge of ELK Stack, including Elasticsearch, Logstash, Kibana, and Beats
Experience in integrating security with Elasticsearch using SAML, LDAP, and Kerberos
Proficient with AWS services such as CloudWatch, CloudTrail, and Lambda.
Responsibilities
Collaborate with the Monitoring and Analytics Team to design and develop observability solutions
Engage with application owners to architect Elasticsearch Stack solutions for enhanced performance
Design and configure data pipelines for effective onboarding of application logs
Develop Ansible playbooks for automated deployment of agents across platforms
Create alerting solutions with Elastic and integrate with ticketing systems
Participate in agile development processes, ensuring alignment with organizational goals
Build AI-driven observability solutions to facilitate efficient incident response.
Benefits
Access to ongoing professional development and training
Opportunity to work with cutting-edge technologies
Collaborative and innovative work environment
Flexible work options and supportive work-life balance
Comprehensive health and wellness programs.
Full Job Description
Job Description
The Senior ITSMA Observability Engineer is responsible for the design and development of the Elastic and Prometheus Stack, as well as, AWS Observability tools that monitor and manage critical applications and infrastructure at HedgeServ. As an important member of the ITSMA Monitoring and Analytics Team, the Senior Engineer will be responsible for the operation and design of the portfolio of tools, which include alerting mechanisms and escalation, dashboards, and the overall framework to support the management of HedgeServ's infrastructure, systems, and applications. Additionally, this role entails leading IT infrastructure monitoring projects and vendor management and handling daily operations with SME (Subject Matter Expert) escalation support as needed. The successful applicant should possess the ability to collaborate with various IT teams to gather requirements and develop solutions by means of existing monitoring capabilities or customized monitors (scripts).
Role Responsibilities
The Senior ITSMA Observability Engineer will collaborate with the ITSMA Monitoring and Analytics Team to design, build, secure, maintain, optimize, and document solutions utilizing Elastic Cloud Stack and AWS-managed Prometheus.
Proficiency with Elasticsearch, Logstash, Kibana, Beats, APM with X-Pack, Prometheus, Grafana, AWS CloudWatch, and other observability tools
Experience with OTEL Collectors
Engage closely with application owners, engineers, and development teams to evaluate requirements, architect, and support an Elasticsearch Stack solution, as well as structure queries to enhance system performance and efficiency
Design and configure ETL data pipelines using Elastic Common Schema for onboarding application logs and metrics
Configure index templates and manage data lifecycle (ILM) for effective data retention
Develop Ansible playbooks for automated deployment of Beat agents across on-premises and AWS systems; utilize Terraform for safe management of production infrastructure, employing methodologies such as Infrastructure as Code within AWS environments
Create Elastic alerting solutions via Watcher and Kibana Alerts integrated with existing ticketing tools and MS Teams
Develop Machine Learning jobs to dynamically monitor and provide alerts based on specific metrics and KPIs
Build Elastic and AWS observability AI solutions that enable infrastructure engineering and operations teams to address production issues efficiently
Adhere to lifecycle processes for transitioning solutions from Development to QA to Production
Actively participate in collaborative group sessions, attend agile sprint daily meetings, and share progress to ensure solution development aligns with organizational requirements
Pre-Requisite Knowledge, Skills and Experience
Technical Degree in Information Technology
Experience with Elastic Cloud and AWS Managed Prometheus
Knowledge of installation, system tasks, data collection, network troubleshooting, data pipelines, and cluster administration
Proficient in Python, Bash, PowerShell, Painless, and other scripting languages
Extensive ELK Stack expertise, including Elasticsearch, Logstash, Kibana, Beats, Machine Learning, APM, X-Pack, and REST API integration
Skilled in evaluating and tuning Elastic clusters, configurations, indexing, search performance, security, and administration
Proficient with Prometheus, Grafana, AWS observability tools, and their performance, security, and management
Experienced with security integrations (Windows SAML, LDAP, Kerberos) in Elasticsearch
Adept with AWS services: CloudWatch, CloudTrail, Kubernetes, Docker, Lambda
Integrated Elastic alerting with third-party ticketing tools
Experienced in implementing and integrating observability AI agents and frameworks for automated analysis, incident detection, and proactive resolution across complex systems
