Position Summarywe are looking for a Data Hub Developer to own the operation, maintenance, and ongoing improvement of an event streaming data integration platform that supports a large-scale case management system. This platform enables secure, near real time data sharing between our organization and multiple external partner systems. The role owns the Kafka based event pipeline, including ingestion, schema validation, enrichment, and distribution, and leads a planned migration from a self-managed Kafka cluster to a managed streaming service on AWS. This is a data engineering and cloud infrastructure role, distinct from application or business process automation development, and the person in this role will serve as the primary technical point of contact for onboarding new data sharing partners and resolving integration issues..
Roles and Responsibilities• Design and develop the program Data Hub event-driven architecture using Apache Kafka and related streaming components.
• Implement event gateways, pub/sub flows, enrichment, and stream connectors that persist event data into business systems.
• Develop and tune complex SQL queries, stored procedures, and schemas for Oracle and MySQL databases.
• Apply DevSecOps practices and perform CVE remediation across the streaming platform.
• Serve as alternate contract manager, supporting contractual coordination and reporting as needed.
• Document data flows, architecture, and root cause analyses.
Required Skills and Experience• Bachelor's degree in Computer Science, Information Systems, or related field (or equivalent experience).
• 6+ years of experience in data engineering, systems integration, or streaming-platform development, including production support of mission-critical systems.
• Demonstrated hands-on experience with Apache Kafka in production - topic/partition design, consumer groups, exactly-once semantics, and Kafka Connect.
• Direct experience migrating self-managed Kafka to AWS Managed Streaming for Kafka (MSK), or equivalent managed-service migration experience.
• Experience working across hybrid cloud environments (Azure and AWS) in an integrated architecture.
• Experience with relational databases (Oracle preferred) including SQL and stored procedure development for connector/reporting integration.
• Experience with data lake / analytics integration patterns (S3, ETL pipelines) and BI/reporting tools (Tableau preferred).
Required Technical Skills- Streaming Platform:
Apache Kafka, Kafka Connect, Schema Registry, AWS MSK, AWS MSK Connect - Cloud:
- AWS: EC2, S3, IAM, VPC, CloudWatch, CloudFormation/Terraform, RDS
- Microsoft Azure: Event Gateway hosting, Azure networking
- Data Engineering:
Stream processing, event enrichment/denormalization, ETL, schema validation, versioning - Databases:
- Oracle (SQL, PL/SQL)
- Cosmos DB (preferred)
- MySQL (preferred)
- Security & Identity:
Login.gov, SSO federation, secure event monitoring, encryption in transit, encryption at rest - Programming:
Java, Python, Node.js, JavaScript, GraphQL - DevOps:
CI/CD for streaming services, Infrastructure-as-Code (IaC), observability tooling, monitoring tooling - Agile Tooling:
JIRA, Confluence
Does this opportunity sound like a fit for you? If so, join our talent community and click to apply now!!