Active TS/SCI security clearance required at application.
U.S. citizenship is mandatory.
8+ years in IT operations, systems engineering, or monitoring engineering, with 5+ years in hands-on Splunk engineering.
2+ years of experience building and operating Splunk ITSI in production environments.
Strong Search Processing Language (SPL) skills for search optimization and data model acceleration.
Proficiency in Linux administration and scripting (Python, Bash) for Splunk support.
Experience integrating Splunk with ITSM platforms, preferably ServiceNow.
Responsibilities
Design and maintain ITSI service trees, including service decomposition and dependency mapping.
Develop KPIs and configure thresholds for service health scores using machine learning.
Create glass tables and service analyzer views for various operational audiences.
Tune event analytics and manage notable event aggregation policies for effective incident response.
Onboard and normalize data sources for ITSI, ensuring CIM compliance and entity enrichment.
Monitor ITSI performance and administer the underlying Splunk platform as needed.
Document service models and mentor junior staff on monitoring strategies.
Benefits
Comprehensive medical, dental, and vision benefits for employees and families.
Paid time off plan promoting work-life balance and personal well-being.
Career development opportunities, including support for training and certifications.
401(k) plan with discretionary company match and no waiting period for enrollment.
Eligibility for referral bonuses for new hires and business development referrals.
Full Job Description
Olympus Solutions, Inc. is seeking a Full-Time, highly motivated Senior Splunk ITSI Engineer to own the service intelligence layer of a federal customer's Splunk environment. In this hands-on engineering role, you will model mission and IT services in Splunk IT Service Intelligence (ITSI), design the KPIs and thresholds behind service health scores, tune event analytics so operators see real problems instead of noise, and keep a search-heavy ITSI deployment performing. You will serve as the customer's primary ITSI subject matter expert, working onsite with government and contractor operations staff.
This position is 100% onsite at a government facility in the Maryland / Washington, DC metro area. No remote or hybrid option is available.
An active TS/SCI clearance is required at time of application.
Position Details
Schedule - Standard business hours, with occasional after-hours support for upgrades and incident response.
Travel - Minimal.
Employment - Full-time, exempt.
Salary Range - $165,000 to $195,000 annually. Placement within the range depends on depth of ITSI experience, Splunk certifications, and overall qualifications.
Clearance and Eligibility - Active TS/SCI required at time of application. Olympus will not sponsor an initial clearance for this position. U.S. citizenship required.
Duties and Responsibilities
Service Modeling and KPI Design
Design, build, and maintain ITSI service trees, including service decomposition, entity definition and discovery, dependency mapping, and service templates.
Develop KPIs and shared KPI base searches, and configure static and adaptive (machine learning) thresholds, time policies, and health score weighting.
Create and maintain glass tables, deep dives, and service analyzer views for NOC, operations, and executive audiences.
Event Analytics and Data Onboarding
Build and tune event analytics, including correlation searches, notable event aggregation policies, episode review workflows, and ITSM integration (ServiceNow or equivalent) for ticketing.
Onboard and normalize data sources feeding ITSI, including Common Information Model (CIM) compliance, entity enrichment, and content pack deployment.
Platform Performance and Administration
Monitor and tune ITSI performance, including search scheduler load, KPI search concurrency, backfill, and summary index health.
Administer the underlying Splunk Enterprise or Splunk Cloud platform as needed, including search head and indexer configuration, apps and add-ons, role-based access control, and version upgrades.
Support the security posture of the environment, including STIG application, audit logging, and change management.
Documentation and Leadership
Document service models, KPI definitions, runbooks, and standard operating procedures, and brief government stakeholders on service health and monitoring maturity.
Mentor junior Splunk staff and provide technical direction on monitoring strategy.
Required Qualifications
Active TS/SCI security clearance. Olympus will not sponsor an initial clearance for this position.
U.S. citizenship.
8+ years of IT operations, systems engineering, or monitoring engineering experience, including 5+ years of hands-on Splunk engineering.
2+ years building and operating Splunk ITSI in production, including service modeling, KPI design, and event analytics, not just consuming dashboards built by others.
Strong Search Processing Language (SPL) skills, including base searches, data model acceleration, and search optimization.
Linux administration and scripting (Python, Bash) in support of Splunk.
Experience integrating Splunk with an ITSM platform (ServiceNow preferred).
Bachelor's degree in Computer Science, Information Systems, or a related field, or four additional years of relevant experience in lieu of a degree.
Preferred Qualifications
Splunk ITSI Certified Admin.
Splunk Enterprise Certified Admin or Splunk Enterprise Certified Architect.
Experience with Splunk Enterprise Security or Splunk Observability Cloud and how each interoperates with ITSI.
Experience supporting DoD, Intelligence Community, or federal civilian operations centers.
Working knowledge of ITIL service management and AIOps concepts.
Experience running Splunk on AWS GovCloud or Azure Government.
DoD 8140 baseline certification (Security+ or higher).
Company and Benefits
Olympus Solutions offers a competitive benefits package designed to give employees personal, professional, and financial flexibility. Benefits include:
Medical, Dental, and Vision - Comprehensive health benefits for employees and their families.
Work-Life Balance - A paid time off plan and a culture that values balance, accountability, and personal well-being.
Career Development - Career-building opportunities, professional development, and support for training and certifications.
Financial Security - A 401(k) plan with a discretionary company match and no waiting period before enrollment.
Referral Bonuses - Eligibility for referral bonuses for qualified new-hire and business development referrals.
