Kafka Subject Matter Expert

Centurion Consulting Group LLC

$120K — $180K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of hands-on Kafka experience in hybrid multi-cloud environments.
  • Proficiency in producing technical artifacts related to Kafka, such as design documents and implementation plans.
  • Strong knowledge of Kafka's design principles and migration strategies for applications.
  • Familiarity with Confluent Platform, Apache Strimzi, and Kafka API compatibility with cloud services.
  • Experience with Kafka Connect and various connectors like JDBC and Google BigQuery.

Responsibilities

  • Integrate new Kafka cluster requirements into existing enterprise architectures.
  • Provide design and architecture assessments for Kafka event streams.
  • Troubleshoot production Kafka issues and recommend resolutions.
  • Research and document best practices for Kafka in hybrid cloud environments.
  • Build prototypes for Kafka components to evaluate capabilities.
  • Define standards for Kafka lifecycle and implement automation strategies.
  • Develop roadmap strategies for expanding Kafka ecosystem capabilities.

Benefits

  • Onsite work in Washington DC, fostering collaboration and teamwork.
  • Exposure to innovative projects in the Kafka ecosystem and cloud technologies.
  • Opportunity for professional development and continuous learning within a large IT organization.
Full Job Description
Job Description

Centurion is looking to hire a Kafka SME for one of our federal government clients in Washington DC. This role is onsite, 100% of the time.

Required Skills:
• Chosen resource must demonstrate these capabilities through actual work experience not merely training:
o Hands-on experience designing and implementing kafka event streaming capabilities in applications and infrastructure across hybrid multi-cloud environments.
o Experience producing IT technical artifacts, with an emphasis on kafka event streams, including design documents, architecture diagrams, architecture assessments, white papers, test plans, requirements mapping, and implementation plans.
o In-depth knowledge of design principles and inner workings of kafka implementations and applicable use cases for migrating applications from legacy style to modern style with the use of Event Streams and Async APIs.
o Demonstrable knowledge of Apache Kafka, Confluent Platform, Confluent Cloud.
o Demonstrable knowledge of Apache Strimzi, Confluent for Kubernetes.
o Demonstrable knowledge of Cloud services with Kafka API compatibility (e.g. Azure Event Hub, Amazon MSK).
o Demonstrable knowledge of Confluent Schema Registry and serialization using JSON and AVRO schemas.
o Demonstrable knowledge of kafka replication options including Mirror Maker, Confluent Cluster Linking and Schema Linking.
o Demonstrable knowledge of Confluent Identity Mgmt and RBAC, integrated/federated with enterprise IDP & role management.
o Demonstrable knowledge of Kafka Client APIs (Producer, Consumer, Streams).
o Demonstrable knowledge of Kafka Connect and Connectors (e.g. JDBC, Cassandra, Google BigQuery, Websphere MQ, etc).
o Demonstrable knowledge of sizing and capacity planning for kafka clusters.
o Demonstrable knowledge of kafka topic partitioning strategies including partition key design strategies.

Preferred Skills:
o integrating kafka event streams with Agentic AI workflows.
o Using design patterns for building scalable and maintainable applications/solutions.
o Clearly document code, models, and technical solutions.
o Proficiency in Generative AI and prompt engineering.
o Continuous learning and adaptability in a very large IT organization
o Communicating complex technical concepts to both technical and executive stakeholders.
o Troubleshooting software and technical implementations in large-scale enterprise ecosystems.
o Understanding of concepts like CI/CD, containerization, and deployment strategies for kafka components in large-scale production environments.
o Querying and managing data in both SQL and NoSQL databases.
o Proficiency creating technical diagrams with products like Microsoft Visio or Draw.io.
o Proficiency creating technical design and architecture documents in Microsoft Word.
o Proficiency creating business and technical presentations in Microsoft PowerPoint.
o Proficiency creating data representations, charts and reports in tools such as Microsoft's Excel worksheets and Power BI.

Day to Day Responsibilities:
o Analysis support to integrate new kafka cluster and event stream requirements into established large-scale, production enterprise architectures.
o Conduct Design and Architecture assessments and provide written recommendations for integrating kafka event streams within an application domain or enterprise event brokering.
o Troubleshoot production kafka event streams and software integration issues as top tier internal support, including review of performance issues and proposing resolutions.
o Conduct research and provide written reviews of kafka ecosystem best practices and innovative strategies for hybrid multi-cloud high availability.
o Conduct proof of concept activities and build prototypes for kafka technology stack components in sandbox environments to assess new capabilities.
o Define and implement standards and patterns for kafka ecosystem life cycle, test-driven protection schemes, and automated implementation strategies.
o Devise strategies and roadmaps for enterprise expansion of kafka ecosystem capabilities, integrations, and governance.
o Strategy and compliance reviews and recommendations for enterprise kafka ecosystem elements which may include the following: architecture frameworks, databases, network, web and application architecture resources, backup and recovery, high availability, disaster recovery, patch management and analytics.

Similar Jobs

More Information Technology Jobs

Find similar Kafka Subject Matter Expert jobs: