Splunk Observability Engineer

System One Holdings, LLC

$110K — $130K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience as a Splunk administrator in large-scale environments.
  • Expertise in writing and optimizing complex SPL queries.
  • Proficient with AWS services including EC2 and CloudWatch.
  • Hands-on experience with OpenTelemetry, particularly in Splunk integration.
  • Automation skills in Python for task efficiency.
  • Familiarity with CI/CD processes using GitLab and GitHub.
  • Demonstrated strong troubleshooting and communication abilities.

Responsibilities

  • Run and upgrade Splunk Enterprise on AWS (EC2) environments.
  • Manage the complete data lifecycle from ingestion to recovery.
  • Write and tune complex SPL queries to optimize performance.
  • Build dashboards for effective monitoring and incident response.
  • Address and resolve ingestion failures and data outages.
  • Restore and replay data following interruptions to maintain continuity.
  • Connect Splunk with CloudWatch and OpenTelemetry for enhanced observability.

Benefits

  • Work in a dynamic and fast-paced environment.
  • Opportunity to lead cross-team troubleshooting efforts.
  • Engage in diverse projects involving advanced technologies.
  • Access to continuous learning and professional development resources.
Full Job Description
For immediate consideration, please connect with me on LinkedIn at https://www.linkedin.com/in/dpotapenko and then email me your resume, work authorization status, current location, availability, and compensation expectations directly to [redacted] - make sure to include the exact job title and job location in your email message.

*** no C2C with 3rd parties, no contractors - W2 salaried candidates only

*** Applicants must be U.S. citizens, Green Card holders or current H-1B visa holders willing to transfer their visas ( H-1B visa transfer )

*** Must be able to work on site in either of the following locations : Lafayette, LA - Knoxville, TN - Columbia, SC - Birmingham, AL


Splunk Observability Engineer :

Hands on role supporting large Splunk and observability platforms in an AWS production setting.

  • Run, upgrade and support Splunk Enterprise on AWS (EC2)
  • Manage the full data lifecycle: ingestion, indexing, search, dashboards, alerts, retention and recovery
  • Write and tune complex SPL queries
  • Build dashboards for monitoring and incident triage
  • Fix ingestion failures, missing data, volume spikes and outages
  • Restore and replay data after interruptions
  • Reduce noise, storage use and cost
  • Connect Splunk with CloudWatch and OpenTelemetry
  • Build and maintain OpenTelemetry agent and collector packages
  • Automate tasks with Python
  • Handle patching and security fixes
  • Lead troubleshooting calls across teams
  • Take part in on call rotation


Requirements

  • Strong Splunk admin experience in large production setups (forwarders, indexers, search heads)
  • Advanced SPL skills
  • Strong AWS experience: EC2, ALB, CloudWatch
  • Hands on OpenTelemetry experience, including Splunk integration
  • Python for automation
  • GitLab, GitHub, Terraform Enterprise, CI/CD, JSON
  • Strong troubleshooting and clear communication skills


For immediate consideration, please connect with me on LinkedIn at https://www.linkedin.com/in/dpotapenko and then email me your resume, work authorization status, current location, availability, and compensation expectations directly to [email protected] - make sure to include the exact job title and job location in your email message.

#M1

#LI-DP1

Ref: #404-IT Pittsburgh

Similar Jobs

More Jobs at System One Holdings, LLC

More Information Technology Jobs

Find similar Splunk Observability Engineer jobs: