Full Job Description
NSI requires a Data Engineer to support CENTCOM Headquarters Logistics Operating Environment 3.0. Upon award of contract the Data Engineer will design and implement a high-throughput data pipeline architecture that integrates structured and unstructured data from logistics systems (e.g., GCSS-Army, LMP, DRRS, etc.) into a centralized data lake. The architecture will leverage Apache Kafka for real-time streaming data and ETL frameworks such as Apache NiFi or Apache Airflow for batch processing. Data Governance: Implement data quality frameworks to ensure data integrity across systems, including data lineage tracking and audit trails. Cloud Data Solutions: The team will leverage cloud-based platforms such as AWS S3, Azure Blob Storage, or Google Cloud Storage for scalable data storage and compute. The team will also ensure data security with encryption at rest and in transit, utilizing AWS KMS or Azure Key Vault. The complexity of building data pipelines that integrate multiple legacies and modern systems requires dedicated engineers. The volume of data from various systems, coupled with the need for real-time processing and the secure handling of sensitive information, necessitates, historically, a team of two engineers to ensure continuous system operation, integration, and troubleshooting.
Location: Tampa, FL (Onsite MacDill AFB)
Education: Bachelors Degree
Experience: 5+ Years experience, proficiency in AWS/Azure, Python, SQL/NoSQL, Spark, Kafka
Security Clearance: Top Secret or Actively Top Secret Eligible is required. Must be a U.S. citizen.