Kafka Integration Platform Engineer

BRMi

$108K — $118K *
US-AnywhereRemote in Virginia, US
Finance & Insurance
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in enterprise messaging and event-driven platforms
  • 3+ years of hands-on Confluent Kafka administration
  • Ability to manage Kafka deployments across various environments
  • Proficiency in Kafka cluster sizing, broker management, and capacity planning
  • Experience troubleshooting Kafka producers, consumers, and brokers
  • Familiarity with Confluent tools like Control Center and Schema Registry
  • Knowledge of Kafka security practices like TLS, RBAC, and encryption

Responsibilities

  • Design and manage Kafka infrastructure for optimal performance
  • Build and optimize data pipelines integrating with various data sources
  • Continuously monitor and troubleshoot Kafka systems to ensure reliability
  • Collaborate with development and data teams to integrate Kafka solutions
  • Automate operations using tools like Terraform or Ansible
  • Implement security measures for Kafka data protection
  • Ensure high availability and disaster recovery for Kafka systems

Benefits

  • Comprehensive Medical, Dental, and Vision Insurance
  • Employer-Paid Life Insurance
  • Employer-Paid Short-Term and Long-Term Disability Insurance
  • 401(k)
  • Paid Time Off (PTO) including Vacation and Sick Leave
  • Educational Assistance
Full Job Description
Overview

BRMi is seeking a Kafka Integration Platform Engineer to support a large financial services client. An in-person interview is required for this position at a near campus location (Vienna VA or Pensacola FL) to prevent employment fraud.

 

Benefits:• Comprehensive Medical, Dental, and Vision Insurance• Employer-Paid Life Insurance• Employer-Paid Short-Term and Long-Term Disability Insurance• 401(k) • Paid Time Off (PTO) that includes Vacation Leave, Sick Leave, and 11 Paid Holidays• Educational Assistance

 

Salary: $108-118K

 

**Can be 100% remote in TX, VA, MD, DC, WV or FL**

 

 

ResponsibilitiesA Kafka Engineer is responsible for designing, implementing, and managing Kafka-based streaming data pipelines, ensuring high availability, scalability, and real-time data processing across systems.
  • Design and Manage Kafka Infrastructure: Kafka Engineers configure, deploy, and maintain Kafka clusters, ensuring optimal performance, reliability, and scalability for real-time data streaming applications
  • Design Kafka cluster environments, manage topics and schemas, and implement security measures to protect data streamsDevelop and Maintain Data Pipelines:
  • Build and optimize Kafka-based data pipelines, integrating with databases, NoSQL stores, and cloud storage using Kafka Connectors (e.g., JDBC, MongoDB, S3) to enable seamless data ingestion and processing
  • Monitor and Troubleshoot: Kafka Engineers continuously monitor system performance, troubleshoot issues, and resolve Kafka-related problems to minimize downtime and ensure uninterrupted data flow
  • Collaboration and Integration: work closely with development and data teams to integrate Kafka into applications and services, supporting real-time analytics and data-driven decision-making
  • Automation and Optimization:Automate cluster operations using infrastructure-as-code tools like Terraform or Ansible, optimize configurations for performance, and ensure efficient resource utilization
Qualifications

 5+ years of experience supporting enterprise messaging and event-driven platforms.

 3+ years of hands-on administration experience with Confluent Kafka.

 Experience managing multi-environment Kafka deployments (Development, QA, Performance, DR, and Production).

 Experience with Kafka cluster sizing, broker management, partition strategy, replication, retention policies, and capacity planning.

 Experience in troubleshooting producer, consumer, broker, and cluster-level issues.

 Experience with Confluent Control Center, Schema Registry, Connect, ksqlDB, and stream processing technologies.

 Experience implementing high availability, disaster recovery, and multi-cluster replication strategies.

 Hands-on experience with Kafka security, including TLS, mTLS, RBAC, ACLs, encryption, and authentication mechanisms.

 Experience integrating Kafka with Kubernetes/OpenShift, cloud platforms, observability tools, and CI/CD pipelines.

 Strong understanding of event-driven architecture, data contracts, and enterprise integration patterns.

 Preferred candidates with confluent certifications

 

**BRMi will not sponsor applicants for work visas for this position.**

**This is a W2 opportunity only**

 

Similar Jobs

More Jobs at BRMi

More Finance & Insurance Jobs

Find similar Kafka Integration Platform Engineer jobs: