Job Description
Job Summary
We are looking for a Data Engineer II to join our Digital Architecture Team (DAT). In this role, you will be responsible for building and maintaining the high-performance data pipelines that create the "Digital Thread"-connecting critical engineering and operations data across the product lifecycle.
You will work within a modern, containerized ecosystem to ensure that data is collected, aggregated, and stored reliably. This is a hands-on engineering role where you will implement data schemas, develop microservices, and optimize the flow of information from legacy systems into modern cloud-based and self-hosted environments.
Key Responsibilities
Pipeline Development: Build and maintain automated ETL/ELT pipelines to integrate diverse data streams, ensuring high availability and data integrity.
Implementation* Develop and deploy data schemas and Protobuf models to support a scalable gRPC microservices platform.
Database Management: Perform day-to-day administration, tuning, and optimization of Postgres databases and related extensions.
Infrastructure Support: Deploy and manage data tools within Docker and Kubernetes environments, ensuring stability across hybrid (Cloud and Windows) infrastructure.
Collaborative Execution: Work closely with Senior and Principal Engineers to translate architectural blueprints into production-ready code.
Data Quality: Implement automated testing and validation checks to ensure data accuracy and reliability for end-users.
This position will be posted for at least 5 calendar days. The posting will remain active until the position is filled, or a qualified pool of candidates is identified.
Required Skills and Education
Required Education & Experience
Education: Bachelor's Degree in Computer Science, Software Engineering, or a related technical field.
Experience: 3-6 years of professional experience in software development or data engineering, with a focus on building production data pipelines.
Core Technical Stack:
Languages: Proficiency in Python.
Databases: Solid experience with Postgres and SQLAlchemy or similar.
Preferred Skills and Education
Preferred Skills & Qualifications
Experience with data orchestration tools (e.g., Airflow, NiFi, or Cribl).
Familiarity with dbt (data build tool) for data transformation.
Knowledge of Medallion Architecture (Bronze, Silver, Gold layers).
Experience working with legacy Windows-based server infrastructure.
Clearance: Ability to obtain and maintain a U.S. Secret Clearance.
DevOps Tools: Hands-on experience with Docker and Kubernetes or similar.
Version Control: Strong proficiency with Git and CI/CD workflows or similar.
Data Transport: Experience with Protobuf and gRPC (or similar API-driven data movement) or similar.
#ECSSE
