Lead Data Engineer

The MITRE Corporation

$155K — $232K *
Aerospace & Defense
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science or related field with 8 years of relevant experience.
  • Active DoD Top Secret Clearance required.
  • Proficient in Python and SQL with a solid foundation in data engineering principles.
  • Hands-on experience with distributed data processing and cloud-based platforms.
  • Experience in data modeling, ETL development, and data governance practices.

Responsibilities

  • Design and maintain secure, scalable data platforms in both cloud and self-hosted environments.
  • Develop data processing solutions for various data types including streaming and batch.
  • Create and optimize data models, schemas, and storage architectures for analytical needs.
  • Evaluate data quality and implement governance and access control strategies.
  • Translate stakeholder requirements into actionable engineering solutions.
  • Diagnose and resolve complex system and data-related issues.
  • Stay updated on emerging data technologies and recommend their use based on mission benefits.

Benefits

  • Participation in MITRE's internal research and development program.
  • Opportunities to work on projects with significant national importance.
  • Innovative and collaborative work environment.
  • Potential for mentorship and professional growth through knowledge sharing.
  • Flexible hybrid work options with a minimum on-site requirement.
Full Job Description
Department Summary:

MITRE's Data Science and Engineering department is looking for qualified applicants to bring their advanced data engineering skills to bear on solving problems of critical national importance. MITRE's diverse work program provides opportunities to apply your expertise and creative thinking in challenging domains such as national security, intelligence, transportation, and healthcare. Employees may also participate in MITRE's internal research and development program, which provides funding for innovative applied research that addresses our sponsors' hardest problems.

Roles & Responsibilities:

The successful candidate for this position is an experienced Data Engineer who combines strong foundations in computer science and software engineering with hands-on experience designing and implementing data systems to solve mission problems. This role requires practitioners with expertise in data modeling, processing, infrastructure engineering, and operational deployment. Our organization values innovation and believes that keeping up with the latest research and technologies is essential.

Expectations for this position are as follows:
  • Design, build, and operate secure, scalable, and maintainable data platforms and pipelines in cloud-based and self-hosted environments.
  • Develop batch and streaming data-processing solutions for structured, semi-structured, and unstructured data.
  • Create data models, schemas, interfaces, and storage architectures that support mission and analytical requirements.
  • Evaluate and improve data quality, lineage, governance, access controls, and secure data-handling practices.
  • Translate sponsor and stakeholder needs into technical requirements and practical engineering solutions.
  • Diagnose complex system, performance, reliability, and data-quality problems.
  • Evaluate emerging data technologies and recommend their use when they provide meaningful mission or engineering benefits.
  • Establish and promote software engineering practices such as automated testing, version control, code review, modular design, observability, and continuous integration.
  • Communicate complex technical concepts clearly to both technical and non-technical audiences.
  • Contribute to applied research, prototypes, and technical publications, as appropriate.
  • Lead technical workstreams or complex projects involving multiple contributors, dependencies, risks, and stakeholders.
  • Mentor engineers and transfer technical knowledge across teams.


The candidate should have hands-on experience in several of the areas specified below, however it is not required that a candidate has experience in all of these areas.

Data Engineering
  • Distributed Data Processing and Big Data Architectures, such as Spark, Hadoop, Ray, Dask
  • Data Storage and Data Lakehouse Architectures, such as RDBMS, Amazon S3, Iceberg, Delta Lake
  • Cloud-based Data Platforms, such as Databricks, Palantir Foundry, Microsoft Fabric, and Amazon EMR
  • Data Pipeline/ETL Development, Integration, and Orchestration, such as Airflow, Dagster, NiFi
  • Batch and Streaming Data Processing
  • Data Modeling, Schema Design, and Data Quality Assessment
  • Data Governance, Access Controls, and Secure Data Handling
  • Performance Optimization and Reliability Engineering


Software Development
  • Computer Programming and Databases - Advanced proficiency in Python and SQL required
  • Software Engineering Best Practices (e.g., version control, testing, modular design)
  • Linux-based Development Environments, Git, and Cloud Platforms
  • Use of Containerization and Orchestration, such as Docker and Kubernetes


Basic Qualifications:
  • Bachelor's degree in Computer Science, Software Engineering, Information Systems, Information Technology, or related field with 8 years of relevant experience.
  • Advanced, hands-on proficiency with Data Engineering approaches, including distributed data processing, cloud-based data platforms, data lakehouse architectures, ETL orchestration, data modeling, and data governance.
  • Active DoD Top Secret Clearance.
  • Per the U.S. Government's eligibility requirements for a clearance, U.S Citizenship is required.
  • This position requires a minimum of 50% hybrid on-site


Preferred Qualifications:
  • Master's degree in Computer Science, Software Engineering, Information Systems, Information Technology, or related field with 6 years of relevant experience; PhD in Computer Science, Software Engineering, Information Systems, Information Technology, or related field with 3 years of relevant experience.
  • Active DoD Top Secret Clearance with Counterintelligence (CI) Polygraph.


This requisition requires the candidate to have a minimum of the following clearance(s):
Top Secret

This requisition requires the hired candidate to have or obtain, within one year from the date of hire, the following clearance(s):
Top Secret/SCI

Salary compensation range and midpoint:
$155,200 - $194,000 - $232,800 Annual

Work Location Type:
Hybrid

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

Similar Jobs

More Jobs at The MITRE Corporation

More Aerospace & Defense Jobs

Find similar Lead Data Engineer jobs: