Data Engineering Software Developer

SCOUT Solutions • $120K — $145K *
Arlington, VA 22204In-Person
Aerospace & Defense
8 - 10 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, Engineering, or related field with 8+ years of experience
  • Active TS/SCI clearance
  • Security+ certification or higher
  • Hands-on experience with data pipelines (ETL/ELT)
  • Proficiency in Python, Java, SQL, and shell scripting
  • Experience with Elastic Stack and Kafka
  • Familiarity with Linux/UNIX system administration

Responsibilities

  • Design and maintain scalable data systems and pipelines for analytics
  • Integrate data from multiple systems into a quality-compliant platform
  • Implement solutions using Confluent Kafka, Elastic Stack, and AWS
  • Manage data warehouses and lakes for optimized performance and cost
  • Analyze ingestion throughput and storage efficiency on Elastic and Kafka
  • Automate data-related tasks and support CI/CD pipelines
  • Collaborate with teams to deliver actionable data solutions
  • Troubleshoot issues related to data ingestion and platform performance

Benefits

  • Health, dental, and vision insurance
  • Retirement savings options with company match
  • Paid time off and holidays
  • Professional development and certification reimbursement
  • Flexible work environment
  • Employee assistance programs
Full Job Description
Primary Responsibilities:
  • Designs, builds, and maintains scalable, reliable data systems and pipelines to ingest, process, and transform large, complex, and disparate data sources for analytics and reporting.
  • Unifies and integrates data from multiple network operations systems into a consistent, accessible platform, ensuring data quality, accuracy, security, and compliance with DoD and DISA requirements.
  • Implements solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat OpenShift (Kubernetes), including creating Kafka, Elastic, and Logstash pipelines and supporting Kibana visualizations and dashboards with React, JavaScript, and HTML.
  • Develops and manages data warehouses and data lakes to support analytics, reporting, and operational dashboards, optimizing infrastructure for performance, scalability, and cost-effectiveness through automation and best practices.
  • Continually analyze and optimize ingestion throughput, query performance, indexing strategies, and storage efficiency across Elastic and Kafka platforms.
  • Automates data-related tasks such as ETL/ELT processes, data validation, cleansing, monitoring, and supports CI/CD pipelines for automated build, test, and deployment.
  • Collaborates with data analysts, visualization engineers, and other stakeholders to deliver integrated, actionable data solutions, and documents data architecture, integration patterns, and operational procedures.
  • Troubleshoots and resolves issues related to data ingestion, processing, and platform performance, storage, memory, partitioning, and cluster performance.


Basic Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or related technical discipline and 8+ years of relevant experience.
  • An active TS/SCI clearance
  • Willingness to complete and maintain additional customer suitability screenings throughout employment
  • Current Security+ certification or higher/equivalent
  • Hands-on experience designing, building, and maintaining data pipelines (ETL/ELT) and integrating multiple, disparate data sources.
  • Experience with data warehouse and/or data lake technologies (e.g., AWS Redshift, S3, Hadoop, Snowflake, or similar).
  • Proficiency with data engineering tools and languages such as Python, Java, SQL, and shell scripting.
  • Experience with Elastic Stack (Elasticsearch, Logstash, Kibana) and/or Kafka for data ingestion and processing.
  • Familiarity with network operations data (logs, metrics, events, ticketing, CMDB) and related data models.
  • Experience with Linux/UNIX system administration and automation.
  • Knowledge of data security, access controls, and compliance frameworks (DoD, DISA, RMF, STIGs).
  • Experience with CI/CD pipelines, containerized pipelines, version control (Git, Bitbucket), and DevOps practices.
  • Strong communication and documentation skills for collaboration and knowledge sharing.

Preferred Qualifications:
  • Experience with DISA, DISN, or other DoD network environments, including developing and deploying software applications that meet DoD security standards (e.g., STIGs), and knowledge of network security, encryption, and access controls in classified environments.
  • Experience with big data technologies and platforms such as Kafka, Spark, NiFi, Hadoop, Elasticsearch, Logstash, Databricks, and ELK Stack for text mining, summarization, search, and entity extraction.
  • Experience with cloud-based data platforms (AWS, Azure, GCP, AWS GovCloud), cloud-integrated platforms, and infrastructure as code, including networking and security policies.
  • Familiarity with Kubernetes deployment, platform upgrades, patching, configuration management tools (Ansible, Puppet, Chef), and monitoring, alerting, and observability tools (Prometheus, Grafana, Elastic).
  • Experience with BI tools like Kibana and developing and maintaining technical documentation and runbooks.
  • Strong understanding and practical experience with Agile methodologies (Scrum, SAFe), and related tools such as Atlassian JIRA and Confluence.
  • Certified Confluent Developer and Certified Elastic Engineer.
  • Excellent communication and collaboration skills, with experience working remotely with geographically dispersed teams and within a matrixed organization to combine software, integration, and data engineering practices.
  • Apply knowledge of system architecture, networks, and centralized logging (ELK) to support data transformation initiatives.

About SCOUT Solutions

SCOUT Solutions Careers

Joining SCOUT Solutions presents an unparalleled opportunity to become part of a leading team of professionals dedicated to pioneering innovation in their industry. SCOUT Solutions, known for its robust commitment to digital transformation and leadership development, offers a variety of career paths from technology to management.

Explore Job Opportunities

SCOUT Solutions is actively seeking talented individuals for a range of job opportunities designed to foster professional growth and personal achievement. Candidates can explore positions that leverage their unique skills and push the boundaries of what is possible in their career.

Engage in Professional Growth

At SCOUT Solutions, the emphasis on professional growth is paramount. With comprehensive diversity training programs and leadership workshops, employees are equipped to take on challenging roles and make significant impacts. The company supports career advancement through continuous learning and development opportunities, ensuring that every team member can achieve their professional goals.

Experience Our Culture

SCOUT Solutions prides itself on a culture of innovation and inclusivity. The company fosters an environment where creativity flourishes and diverse perspectives are embraced. Employees enjoy a range of benefits that support not only their professional lives but also their personal well-being.

Internship Programs

For those beginning their professional journey, SCOUT Solutions offers internship programs that provide a robust foundation in industry-specific skills and real-world experience. Internships are a stepping stone to full-time employment, offering hands-on training and invaluable networking opportunities within the company.

Join a Dynamic Team

The team at SCOUT Solutions is composed of driven, curious, and creative professionals. Each member brings a wealth of knowledge and experience, contributing to a dynamic workplace where collaborative problem-solving and innovative solutions are the norms.

Hiring Process

SCOUT Solutions' hiring process is designed to identify and attract individuals who are not only skilled but also passionate about their contributions to the industry. The process includes a detailed interview to assess fit both for the position and the company culture. Candidates are encouraged to present a well-crafted resume that highlights relevant experiences and achievements.

Networking and Career Opportunities

SCOUT Solutions places a high value on networking, recognizing that connections within the industry can lead to enriching career opportunities. Employees are encouraged to engage in events and activities that foster professional relationships and career development.

Stay Informed

Stay connected with SCOUT Solutions to keep up to date with the latest company news, insights, and job alerts tailored to specific career interests and skills. Discover the rewarding opportunities that await at SCOUT Solutions and how to become part of a team that is shaping the future of the industry.

SEARCH SCOUT SOLUTIONS JOBS

READ CAREERS BLOG

Job Alert Emails

Personalize your subscription to receive job alerts, latest news, and insider tips tailored to your preferences with SCOUT Solutions. See what exciting and rewarding opportunities await in the journey ahead.
Learn more about SCOUT Solutions
Industry
Business Services
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at SCOUT Solutions

More Aerospace & Defense Jobs

Find similar Data Engineering Software Developer jobs:

NationwideArlington, VA