Axyde Analytics seeks a senior AWS data engineer to design and implement managed-service data-ingestion, transformation, quality, cataloging, and monitoring capabilities for a federal enterprise analytics platform.
Responsibilities- Establish and maintain secure connections to heterogeneous Government and public data sources.
- Ingest structured, semi-structured, and unstructured information.
- Configure Amazon S3, AWS Glue Data Catalog, Glue Crawlers, Athena, Step Functions, EventBridge, and approved managed data-preparation services.
- Design reusable patterns for JDBC, Oracle, Red Hat/Linux, APIs, files, PDFs, scheduled feeds, and unscheduled uploads.
- Incorporate Government-furnished Spark-compatible transformation logic into the approved architecture.
- Implement schema inference, standardization, validation, lineage, quality controls, and exception handling.
- Detect connection failures, schema changes, stale data, duplicates, prohibited data, and other quality issues.
- Support daily refresh requirements and scalable onboarding of new data sources.
- Produce technical documentation, runbooks, data dictionaries, and source-to-interface mappings.
- Support the live technical demonstration and subsequent production transition.
Required Experience- Five or more years of senior AWS data-engineering experience.
- Strong hands-on experience with S3, Glue, Athena, Step Functions, EventBridge, and AWS-native monitoring.
- Experience integrating relational databases, APIs, documents, and mixed-format enterprise data.
- Demonstrated experience with data quality, metadata management, schema evolution, lineage, and operational monitoring.
- Familiarity with Spark, PySpark, JavaSpark, or Spark transformation patterns.
- Experience in federal, regulated, or sensitive-data environments strongly preferred.
Architecture ConstraintImplementation must remain within Axyde's approved AWS managed-service baseline. Candidates must not assume that custom Python, Lambda, containers, EC2, third-party libraries, or external integration platforms may be used.
EngagementU.S. citizenship required. Remote within the United States with occasional travel. Immediate proposal and demonstration support may be available; longer-term work is contingent upon award.