Data Engineer

WarCollar Industries LLC

$110K — $130K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • High School Diploma and 5+ years of software development experience using Python.
  • Proven experience in data engineering with a focus on ETL and data pipeline management.
  • Familiarity with version control systems like Git or GitHub.
  • Proficient in data formats such as JSON, XML, and CSV.
  • Experience with Bash, Linux, and command-line tools.
  • Strong analytical, troubleshooting, and problem-solving abilities.
  • Excellent communication skills for effective collaboration.

Responsibilities

  • Design and maintain resilient data pipelines using Python for effective data collection and analytics.
  • Develop complex data solutions focusing on transformation, quality control, and integrity.
  • Integrate data from various internal and external sources, including API and file-based inputs.
  • Ensure data availability, accessibility, and security to meet operational needs.
  • Test and validate data processes across development and production environments.
  • Provide support for platform maintenance, including debugging and issue resolution.
  • Collaborate with cross-functional teams to enhance data products and analytics.

Benefits

  • Opportunity to work on mission-focused technology initiatives.
  • Contribute to secure and scalable data solutions for U.S. Government customers.
Full Job Description
Job Description

The Data Engineer will leverage strong Python and data engineering expertise to design, develop, and maintain data pipelines and applications supporting the collection, ingestion, transformation, and delivery of cyber data. The ideal candidate will play a critical role in ensuring relevant and actionable data is securely delivered to cyber analysts and data scientists in normalized, reliable, and operationally useful formats.

Required Skills

Core Responsibilities:

  • Design, build, optimize, and maintain resilient data pipelines using Python, with an emphasis on data collection, ingestion, ETL, and analytics.
  • Develop and support complex data solutions, including data transformation, validation, quality controls, and data integrity.
  • Integrate data from diverse internal and external sources, including REST APIs, flat files, and structured and semi-structured data formats.
  • Ensure data is available, accessible, reliable, and securely managed to meet operational and stakeholder requirements.
  • Test, troubleshoot, and validate data movement, parsing, and transformation code across development and production environments.
  • Provide platform and production support, including debugging, root cause analysis, issue resolution, and ongoing system maintenance.
  • Collaborate with software developers, analysts, data scientists, and other cross-functional teams to deliver effective data products and help end users maximize analytics environments.


Desired Skills

Required Qualifications:

  • High School Diploma and 5+ years of software development experience using Python.
  • Demonstrated experience in data engineering, including building and maintaining data pipelines, ETL processes, and ingestion workflows.
  • Experience with Git, GitHub, or similar version control systems.
  • Experience working with common data formats including JSON, XML, CSV, and other structured or semi-structured data.
  • Experience with Bash, Linux, and command-line tools in development and/or production environments.
  • Strong troubleshooting, analytical, and problem-solving skills.
  • Excellent verbal and written communication skills with the ability to collaborate effectively across technical teams.


Additional Details

WarCollar Industries offers the opportunity to work on challenging, mission-focused technology initiatives while contributing to secure and scalable data solutions supporting U.S. Government customers.

Similar Jobs

More Jobs at WarCollar Industries LLC

More Information Technology Jobs

Find similar Data Engineer jobs: