Expertise in distributed computing frameworks for large-scale data processing.
Familiarity with AWS or other cloud environments.
Experience with various datastores including PostgreSQL and MongoDB.
Proficient in Python and relevant data processing libraries.
Knowledge of software platforms like Docker and Kubernetes.
Responsibilities
Identify and implement internal process improvements for system scalability.
Develop data pipelines for end-to-end solutions.
Maintain essential artifacts related to ETL processes.
Integrate data pipelines with AWS services for insights.
Support stakeholder needs regarding data infrastructure.
Design robust data flows for various data types.
Provide Tier 3 technical support for deployed applications.
Benefits
Career growth opportunities within a collaborative environment.
Access to cutting-edge tools and technologies.
Support for off-hours deployments as needed.
Engagement with a government product team and various stakeholders.
Full Job Description
M9 Solutions is seeking a Data Engineer to support a government contract for a client in Bethesda, MD. An active Top Secret SCI clearance is required.
Responsibilities
Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
Develop and design data pipelines to support an end-to-end solution.
Develop and maintain artifacts (e.g., schemas, data dictionaries, and transforms related to ETL processes).
Integrate data pipelines with AWS cloud services to extract meaningful insights.
Work with stakeholders to support their data infrastructure needs and assist with data-related technical issues.
Design and develop robust and functional data flows to support raw data and expected data.
Provide Tier 3 technical support for deployed applications and dataflows.
Define and communicate a clear product vision for the client's software products, aligning with user needs and business objectives.
Create and manage product roadmaps that reflect both innovation and growth strategies.
Partner with a government product owner and a product team of 7 - 8 full-time employees.
Collaborate with the rest of the data engineering team to design and launch new features.
Coordinate and document dataflows, capabilities, etc.
Occasionally (as needed) support for off-hours deployment, such as evenings or weekends.
Required Skills and Qualifications
Top Secret SCI security clearance.
Bachelor's degree or equivalent practical experience.
Expertise in distributed computing frameworks to handle large-scale data processing.
Familiarity with working with Amazon Web Services (AWS) or any other cloud environments.
Working experience with datastores like PostgreSQL, S3, Redshift, MongoDB/DynamoDB, Redis, Elasticsearch/OpenSearch, and SQL.
Proficient in utilizing Python with key libraries like pandas and PySpark, NiFi, Airflow, AWS Lambda, or similar technologies.
Working knowledge of software platforms and services, such as Docker, Kubernetes, JMS/SQS, SNS, and Kafka.
Familiar with Linux/Unix server environments.
Experience with Agile development methodology.
Publishing and/or presenting design reports.
Coordinating with other team members to reach project milestones and deadlines.
Working knowledge of Collaboration tools, such as Jira and Confluence.
Preferred Qualifications
Master's degree or equivalent experience in a related field.
Familiarity and experience with the Intelligence Community and the intel cycle.
Experience with cloud message APIs and usage of push notifications.
Keen interest in learning and using the latest software tools, methods, and technologies to solve real-world problem sets vital to national security.
Working knowledge of public keys and digital certificates.
Experience with DevOps environments.
Expertise in various COTS, GOTS, and open source tools that support the development of data integration and visualization applications.
Experience with cloud message APIs and usage of push notifications.
Specialization in object-oriented programming languages, scripting, and databases.
Full-Time Employee Compensation
M9 Solutions' pay range for this position is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include, but are not limited to, responsibilities of the position, education, experience, knowledge, skills, abilities, as well as internal equity, location, alignment with market data, applicable bargaining agreement (if any), or other law.
M9 Solutions is an IT consulting and staffing firm that provides services to clients in a variety of industries, including healthcare, finance, and government. The company offers a range of services, including project management, software development, and data analytics. M9 Solutions was founded in 2010 and is headquartered in Durham, North Carolina.
