Job DescriptionThe Impact you will have in this role:The Kafka Administrator will play a critical role in ensuring the stability, security, and efficiency of our Confluent Kafka infrastructure. This position is part of the Architecture & Enterprise Services department, responsible for maintaining the firm's IT infrastructure and supporting seamless business operations. The ideal candidate will have strong expertise in Kafka administration, security, performance tuning, and integration.
Your Primary Responsibilities: - Install, configure, and manage Kafka clusters, including Confluent Kafka components.
- Maintain and optimize existing clusters while setting up new environments as needed.
- Continuously monitor Kafka clusters for performance, reliability, and capacity planning.
- Identify and resolve performance bottlenecks, ensuring optimal system efficiency.
- Implement and manage security protocols, including encryption, authentication, and authorization.
- Ensure compliance with industry standards and internal security policies.
- Work closely with development teams to integrate Kafka with various data sources and sinks.
- Configure and manage Kafka connectors to facilitate smooth data flow.
- Plan and execute Kafka upgrades and patches, keeping systems updated with the latest features and security fixes.
- Develop and maintain disaster recovery plans, conducting regular testing to ensure business continuity.
- Manage Kafka topics, including configurations, retention policies, and cleanup settings.
- Provide technical support for Kafka-related issues, collaborating with cross-functional teams to ensure quick resolutions.
- Maintain comprehensive documentation for Kafka configurations, processes, and best practices.
- Contribute to knowledge sharing within the team to enhance operational efficiency.
Qualifications: - Minimum of 6 years of related experience
- Bachelor's degree preferred or equivalent experience
Talents Needed for Success: - Minimum 5 years of experience in Kafka administration, including Confluent Kafka.
- Strong understanding of Kafka security, including encryption, authentication, and authorization.
- Experience with Kafka integration, including configuring and managing Kafka connectors.
- Hands-on experience with Kafka upgrades, patching, and disaster recovery planning.
- Proficiency in troubleshooting Kafka-related issues and optimizing system performance.
- Strong documentation skills and ability to communicate effectively across teams.
- Communicates openly keeping everyone across the organization informed
The salary range is indicative for roles at the same level within DTCC across all US locations. Actual salary is determined based on the role, location, individual experience, skills, and other considerations.
About the TeamServes as a dedicated technology resource for advancing DTCC's business opportunities and providing industry thought leadership for leveraging new technology. The goal of this new department is to partner internally with IT, our business and regulatory divisions and externally with clients, regulators, and fintech vendors, to help build new platforms and business models to advance DTCC's mission to support the financial markets.
