Systems Engineer 6 - Hadoop/Linux/NiFi/XKS/DevOps

Captivation Software$130K — $270K *
Information Technology
15+ years of experience
Job Overview by Ladders

Qualifications

  • Top Secret/SCI U.S. Government security clearance with favorable Polygraph required
  • Bachelor's degree in Engineering or related field with 20 years of experience, or equivalent experience with a High School Diploma or Master's degree with 18 years of experience.

Responsibilities

  • Lead design and sustainment of complex dataflow architectures for mission-critical analytics
  • Manage high-availability Linux and Cloudera Hadoop infrastructures for secure dataflows
  • Engineer end-to-end dataflow solutions ensuring schema compatibility and data governance
  • Implement monitoring and automation strategies to enhance system performance
  • Provide technical leadership for DevOps and Agile/Scrum initiatives
  • Ensure compliance with security and data handling requirements
  • Coordinate with teams to deploy capabilities and support enterprise mission objectives.

Benefits

  • Up to 20% 401k contribution with immediate vesting
  • $3,600 HSA Contribution
  • 6 Weeks Paid Time Off
  • Comprehensive medical/dental/vision/life insurance coverage
  • Short-Term and Long-Term Disability and AD&D insurance included.
Full Job Description
Description

Captivation Software is looking for a principal Data Flow Engineer is a senior technical leader responsible for designing, integrating, and sustaining enterprise-scale dataflow architectures that support mission-critical analytics across secure cloud and distributed environments. This role oversees high-availability Linux and Cloudera Hadoop infrastructures, develops and maintains end-to-end dataflow solutions using technologies such as Niagara files and XKS, and ensures reliable, secure, and compliant data ingestion, processing, and delivery. The position also leads automation, monitoring, troubleshooting, and DevOps initiatives to improve system performance and operational efficiency while coordinating across engineering, operations, analytics, and stakeholder teams to deploy scalable, resilient, and mission-focused dataflow capabilities.

Responsibilities
  • Lead the design, integration, and sustainment of complex enterprise dataflow architectures supporting mission-critical analytics, ensuring reliable ingestion, processing, routing, and delivery across large-scale cloud and distributed environments
  • Manage and optimize high-availability Linux and Cloudera Hadoop cloud infrastructures, including virtual machines, storage containers, and enterprise data repositories, to support thousands of secure operational dataflows
  • Engineer and maintain end-to-end dataflow solutions using technologies such as Niagarafiles and XKS, and related processing systems, ensuring schema compatibility, metadata integrity, and proper data governance throughout the lifecycle
  • Develop and implement monitoring, troubleshooting, and automation strategies utilizing system instrumentation, cron scripting, logging, and operational monitoring tools to improve system continuity, performance, and incident response capabilities
  • Provide technical leadership for DevOps and Agile/Scrum initiatives, including task prioritization, workflow modernization, requirements management, and cross-functional coordination to improve operational efficiency and team performance
  • Ensure compliance with enterprise security, classification, and data handling requirements by applying deep knowledge of intelligence community governance policies, access controls, and secure data routing methodologies
  • Coordinate across engineering, operations, analytics, and stakeholder organizations to deploy new capabilities, transition systems into production, establish standard operating procedures, and support enterprise-wide mission objectives through scalable and resilient dataflow solutions.


Requirements
Security Clearance:
  • Must currently hold a Top Secret/SCI U.S. Government security clearance with a favorable Polygraph, therefore all candidates must be a U.S. citizen
Minimum Qualifications:
  • Bachelor's degree in a Qualified Engineering Field or related discipline from an accredited college or university with twenty (20) years of systems engineering experience.
  • A High School Diploma or GED plus twenty-four (24) years of general systems engineering experience
  • A Master's degree in a Qualified Engineering Field or a related discipline from an accredited college or university plus eighteen (18) years of systems engineering experience.


This position is open for direct hires only. We will not consider candidates from third party staffing/recruiting firms.

Benefits
  • Annual Salary: $130,000 - $270,000 (Depends on the Years of Experience)
  • Up to 20% 401k contribution (No Matching Required and Vested from Day 1)
  • Above Market Hourly Rates
  • $3,600 HSA Contribution
  • 6 Weeks Paid Time Off
  • Company Paid Employee Medical/Dental/Vision Insurance/Life Insurance/Short-Term & Long-Term Disability/AD&D

About Captivation Software

Captivation Software Careers

Joining Captivation Software presents an unparalleled opportunity to become part of a leading team of professionals dedicated to pioneering innovations in the tech industry. As the demand for advanced software solutions escalates, Captivation Software remains at the forefront, offering a plethora of job opportunities that promise not only professional growth but also a commitment to diversity and leadership development.

Explore Career Opportunities

Captivation Software is actively seeking talented individuals for various positions across the company. From software development to marketing, each role is designed to challenge skills and foster professional growth in a supportive environment. Explore open positions that align with your career aspirations and skill set.

Innovation and Professional Growth

At Captivation Software, innovation isn't just a buzzword; it's the cornerstone of the company culture. Team members are encouraged to push boundaries and implement new ideas, driving the company and their careers forward. Leadership supports this journey by providing industry-leading training and opportunities for career advancement.

Diversity and Inclusion

Recognizing the value of diverse perspectives, Captivation Software is committed to creating an inclusive workplace. Diversity training is integral, ensuring all team members feel valued and understood. This commitment to diversity enriches the company culture and enhances the innovative output of the team.

Internship Programs

For those starting their careers, Captivation Software offers internship programs that provide a robust foundation in the tech industry. Interns gain hands-on experience, working alongside seasoned professionals and participating in projects that make real-world impacts. These internships often lead to full-time positions, offering a clear path to employment within the company.

Benefits and Culture

Choosing to work at Captivation Software means more than just a job; it's a decision to enhance one's life. Employees enjoy a range of benefits designed to support both their professional and personal lives. The company culture promotes work-life balance, continuous learning, and a supportive network of colleagues.

Networking and Community

Captivation Software encourages its team to engage in professional networking, providing platforms and opportunities to connect with industry leaders and peers. This community aspect supports not only career development but also innovation and collaboration within the industry.

Applying for a Position

To apply for a position at Captivation Software, candidates are encouraged to submit a resume through the Captivation Software careers page. The hiring process is transparent, with communication at each step, from the initial application to the interview stage. Tailor your resume to highlight relevant experience and skills that align with the job description to increase your chances of success.

Stay Connected

Keep up to date with the latest from Captivation Software by following their careers blog. Gain insights from insiders, learn about new job openings, and get tips on making your application stand out.

Join Captivation Software

Discover the exciting and rewarding opportunities that await at Captivation Software. Search for job opportunities that match your skills and interests, and take the first step towards a fulfilling career with a leader in software innovation. Join a team that values curiosity, creativity, and a drive for excellence.

SEARCH CAPTIVATION SOFTWARE JOBS

Learn more about Captivation Software

Similar Jobs

More Jobs at Captivation Software

More Information Technology Jobs

Find similar Systems Engineer 6 - Hadoop/Linux/NiFi/XKS/DevOps jobs: