Data Engineer

NewGen

$90K — $130K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • TS/SCI FSP Clearance required.
  • High School Diploma with 5+ years' software development experience in Python.
  • Proven experience in data engineering.
  • Familiarity with building and maintaining data pipelines and ETL processes.
  • Skilled in version control using Git/GitHub or similar systems.
  • Understanding of common data formats like JSON, XML, and CSV.
  • Experience with Bash, Linux, and command-line tools.

Responsibilities

  • Design, build, optimize, and maintain resilient data pipelines using Python.
  • Develop and support complex data solutions for transformation, validation, and quality controls.
  • Integrate data from various internal and external sources.
  • Ensure data availability, accessibility, reliability, and security.
  • Test, troubleshoot, and validate code for data movement and transformation.
  • Provide support for platforms, including debugging and issue resolution.
  • Collaborate with cross-functional teams to deliver data products and support analytics use.],
  • benefits:[
Full Job Description
Seeking a motivated, career and customer-oriented Data Engineer to join our Partner's team in Herndon VA. The Data Engineer will leverage their expertise with Python to support the customer's data pipelines and related applications, from collection to ingestion, and ensure the integrity and security of data systems. You will play a critical role in delivering relevant and actionable cyber data to the right customers in a format that is normalized and actionable by cyber analysts and data scientists.

Responsibilities
  • Design, build, optimize, and maintain resilient data pipelines using Python, with a focus on data collection, ingestion, ETL, and analytics
  • Develop and support complex data solutions, including data transformation, validation, and quality controls
  • Integrate data from a variety of internal and external sources, including REST APIs, flat files, and structured/semi-structured formats
  • Ensure data is available, accessible, reliable, and securely handled to meet stakeholder and operational needs
  • Test, troubleshoot, and validate data movement, parsing, and transformation code across development and production environments
  • Provide platform and production support, including debugging, root cause analysis, issue resolution, and ongoing maintenance
  • Collaborate with cross-functional teams to deliver data products and help end users understand and effectively use analytics environments
Requirements
  • TS/SCI FSP Clearance
  • High School Diploma and 5+ years' experience with software development in Python
  • Experience with data engineering
  • Experience building and maintaining data pipelines, ETL processes, and ingestion workflows
  • Experience with Git/GitHub or similar version control systems
  • Experience with common data formats such as JSON, XML, CSV, and other structured or semi-structured data
  • Experience working with Bash, Linux, and command-line tools in a development or production environment

Similar Jobs

More Jobs at NewGen

More Information Technology Jobs

Find similar Data Engineer jobs: