Position Description

The Cribl/Splunk Engineer will design, implement, and maintain secure, scalable data ingestion pipelines using Cribl Edge, Cribl Cloud, and Splunk across a variety of cybersecurity data sources. This role is responsible for optimizing data flows, storage, and infrastructure to improve performance, maintain data integrity, meet OMB M-26-14 requirements, and maximize cost efficiency. The Engineer will administer and maintain Cribl and Splunk environments, troubleshoot technical issues, perform upgrades, and collaborate with SOC and cross-functional teams on tool integration, tuning, and incident response. The ideal candidate brings strong Splunk engineering experience, hands-on Cribl expertise, and the ability to optimize high-volume security data environments for performance, security, and cost.

This position allows for 100% remote work. Remote work requires a high level of trust in our employees, and we strictly adhere to the details outlined in our Remote Work Policy below.

Required Experience

• 4 years of Information Technology Experience
• Bachelor of Science in Computer Science, Information Systems, Mathematics, Engineering, related degree or an additional two (2) years of experience.
• 3+ years of Splunk administration or engineering experience.
• Proficiency in configuring and managing Splunk inputs, setting up data ingestion pipelines, and establishing system connections.
• Knowledge of Splunk's Search Processing Language (SPL), data parsing techniques, and the use of regular expressions for data extraction and transformation.
• Skilled in optimizing data pipelines for performance and efficiency, handling large data volumes, and implementing best practices for data integrity and consistency.

Preferred Qualifications:

• Cribl Certified Service Consultant (CCSC) or Cribl Certified Engineer (CC Engineer) preferred.
• Cribl Certified Admin (Stream and/or Edge) acceptable.
• Splunk Enterprise or Splunk Cloud Certified Admin bonus.
• Experience as an engineering team lead (representing the team's work to clients).
• Strong analytical and problem-solving skills, with the ability to effectively prioritize and execute tasks

Responsibilities

• Design, develop and implement processes for ingesting data from various sources into Splunk using Cribl Edge and Cribl Cloud
• Configure and manage data inputs to accommodate different types of data sources, including logs, metrics, and events to determine compliance with M-26-14 requirements at the FISMA system boundary level.
• Establish and maintain secure and reliable connections between Splunk and external systems or data sources using Cribl Edge and Cribl Cloud
• Monitor, and maintain alerts for failed data inputs.
• Deign and recommend Cribl configurations for optimized performance and maximum cost savings
• Design and implement log storage options maximizing cost efficiency while meeting standards of OMB M-26-14
• Oversee the configuration and maintenance of Cribl and Splunk infrastructure, ensuring optimal performance and security of the environment.
• Collaborate with cross-functional teams to troubleshoot and resolve issues related to Cribl/Splunk functionality.
• Conduct root cause analysis for incidents and implement preventive measures.
• Monitor tool health and performance to identify issues, bugs, or potential improvements.
• Develop, review, and update existing operational documentation (SOPs, Job Aids, application checklists, playbooks, etc).
• Support system access controls, including Account Management, Access Enforcement, Information Flow Enforcement, Least Privilege, and workflow for all user account requests and account recertifications.
• Collaborate with the Security Operations Center (SOC) teams for process optimization, tool tuning, tool integration, information sharing, playbook development, and incident response.
• Perform implementation, administration, operations and maintenance, optimization, & integration of cybersecurity tools, technologies, and services
• Conduct regular Cribl/Splunk Enterprise upgrades for worker nodes, deployment servers, heavy forwarders, and syslog servers.

Benefits Snapshot (includes, but not limited to)
Valiant pays 99% of the Medical, Dental, and Vision Coverage for Full-time Employees
Valiant contributes 25% towards Health Coverage for Family and Dependents
100% Paid Short Term Disability and Life Insurance Policy for Full-time Employees
100% Paid Certifications
401K Matching up to 4%
Paid Time Off
Paid Federal Holidays
Wellness & Fitness Program
Valiant University - Online Education and Training Portal
FSA programs for: Medical Costs, Dependent Care, Transit, and Parking
Referral Bonuses

The salary range for this position is a general guideline and not a guarantee of compensation or salary. It has been benchmarked in relation to the scope of the role, market rate, and internal equity. The salary for this role is expected to be in the $150,000 - $175,000 range. Where a candidate falls within the band can be determined based on one or more of the following: skillset, experience level, achievements, education, geographic location, security clearance, involvement in corporate tasks, and other non-discriminatory factors. In addition to the base salary, this role will include benefits as described above. Valiant reserves the right to adjust the salary range, experience requirements, and position responsibilities at any time without prior notice.

Remote Work Policy

Remote work necessitates a high level of trust in our employees. To ensure that employee performance does not suffer in a remote work environment, all employees who telecommute are expected to have a quiet and distraction-free workspace with adequate internet, dedicate their full attention and availability to their job duties during working hours, and maintain a schedule during core business hours that align with those of their coworkers and Valiant's clients. In alignment with Valiant's inclusive and engaging environment, cameras are encouraged and can be required to be on during virtual video conferences. Additionally, in alignment with the Office of the Inspector General's effort to eliminate conflicting employment, all Valiant employees are required to disclose any current or future outside employment engagements. During onboarding and throughout employment, employees must disclose any current activities or intent to engage in outside employment or other professional activities and obtain written approval. Employees may not solicit or conduct any outside business during core business hours for Valiant Solutions and our clients.