Data Engineer

M9 Solutions • $60K — $180K *

Springfield, VA 22153In-Person

Information Technology

8 - 10 years of experience

1 week ago

By clicking Apply, I agree with Ladders' Terms of Use and Privacy Policy

Job Overview by Ladders

Qualifications

Active TS/SCI security clearance required.
Bachelor's or master's degree in computer science, engineering, or related field.
Over 10 years of experience in data engineering or software development roles.
Proficient in Python with knowledge of libraries like pandas and PySpark.
Experience with cloud services (AWS or Azure) and their data engineering tools.
Demonstrated success in building data pipelines using Kafka and Airflow.
Familiar with database technologies and their trade-offs.

Responsibilities

Collect and integrate data from various structured and unstructured sources.
Design and implement scalable ETL/ELT pipelines for data processing.
Deploy data pipelines and infrastructure using AWS or Azure services.
Optimize database architecture for different storage engines.
Process high-volume, low-latency data streams with Apache Kafka.
Schedule and monitor data workflows with Apache Airflow.
Collaborate with data scientists to integrate ML models into pipelines.

Benefits

Comprehensive health and wellness plans.
Generous paid time off and holidays.
Professional development and training opportunities.
Retirement savings plan options.
Flexible work arrangements and a supportive team culture.

Full Job Description

Data Engineer to work onsite in support of a government contract for a client located in Springfield, VA. An active TS/SCI clearance is required.

Responsibilities

Data Ingestion & Acquisition: Collect and integrate data from a wide variety of structured and unstructured sources, including APIs, RDBMS, file systems, third-party services, and real-time streams.
Pipeline Development: Design and implement scalable ETL/ELT pipelines to clean, enrich, normalize, and semantically align data (ontology-driven transformations).
Cloud Deployment: Build and deploy data pipelines and associated infrastructure on AWS or Azure, using managed services like Lambda, Glue, Step Functions, Azure Data Factory, etc.
Database Architecture: Understand and optimize for different storage engines-relational (PostgreSQL, MySQL), columnar (Redshift, BigQuery), indexing engines (ElasticSearch), key-value stores (DynamoDB, Redis), Object stores (S3 or similar), and caching layers.
Streaming Data Processing: Work with Apache Kafka (or similar platforms) to handle high-volume, low-latency data streams.
Workflow Orchestration: Utilize Apache Airflow (or equivalent) to schedule and monitor complex data workflows.
AI/ML Integration: Collaborate with data scientists to integrate LLMs and ML models into pipelines for inference, tagging, enrichment, or intelligent routing of data.

Required Skills and Qualifications

Active TS/SCI security clearance.
Bachelor's or master's degree in computer science, engineering, or related field.
10+ years of experience in data engineering or software development roles.
Strong proficiency in Python, including experience with libraries like pandas, PySpark, FastAPI, or similar.
Solid experience with cloud services (AWS or Azure) and Cloud native data engineering tools.
Proven experience in building and maintaining data pipelines using Kafka, Airflow, and other open-source frameworks.
Strong grasp of database internals and trade-offs between different storage technologies.
Familiarity with data governance, lineage, and metadata management concepts.
Experience or strong interest in integrating LLMs and AI/ML models into production-grade data systems.

Preferred Skills and Qualifications

Knowledge of data cataloging tools and semantic layer design.
Experience with containerization (Docker) and orchestration (Kubernetes).
Familiarity with MLOps tools or platforms (e.g., SageMaker, MLflow).

Full-Time Employee Compensation

M9 Solutions' pay range for this position is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include, but are not limited to, responsibilities of the position, education, experience, knowledge, skills, abilities, as well as internal equity, location, alignment with market data, applicable bargaining agreement (if any), or other law.
M9 Benefits - https://m9solutions.com/why-join-m9/#our-benefits

Salary Range

$60,000-$180,000 USD

About M9 Solutions

M9 Solutions is an IT consulting and staffing firm that provides services to clients in a variety of industries, including healthcare, finance, and government. The company offers a range of services, including project management, software development, and data analytics. M9 Solutions was founded in 2010 and is headquartered in Durham, North Carolina.

Learn more about M9 Solutions

Size

50 employees

Industry

Information Technology

* Ladders Estimates

Similar Jobs