Charles Schwab

Senior Kafka Platform Engineer

Charles Schwab$120K — $150K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor’s degree in computer science, Engineering, or related field
  • 10+ years of hands-on software engineering experience with proven technical leadership
  • 5+ years of expertise in large-scale distributed systems and mission-critical infrastructure
  • Deep expertise in Confluent Kafka, including capacity planning, administration, and performance tuning
  • Strong hands-on experience with AI-assisted development tools, including GitHub Copilot and advanced prompt engineering
  • Experience with Kubernetes, Confluent Operator, and cloud-native modernization (GCP)
  • Solid foundation in security engineering, including encryption and certificate management.

Responsibilities

  • Design and build AI agents and automation frameworks to enhance engineering workflows at scale
  • Leverage AI-powered tools to automate testing and improve code quality for intelligent SDLC workflows
  • Act as a senior technical authority for Confluent Platform and Cloud, guiding architecture and design solutions
  • Lead solution architecture initiatives for cloud modernization, security, and AI-driven engineering
  • Perform deep-dive analysis of production issues to identify root causes and implement sustainable fixes
  • Streamline Kafka operations with automation tools to boost developer productivity
  • Drive smooth migration of on-prem Kafka workloads to Confluent Cloud ensuring zero disruption.

Benefits

  • Opportunities for professional growth and advancement within the organization
  • Access to cutting-edge technologies and tools in AI and event streaming
  • Engagement in challenging projects with a focus on innovation
  • Exposure to a collaborative, cross-functional work environment
  • Flexibility for remote working and collaboration across time zones.
Full Job Description
Event Streaming team in Enterprise Middleware organization is seeking a Senior Kafka Platform Engineer with experience to lead the evolution of its enterprise event-streaming platform and drive enterprise-scale event streaming, Confluent Cloud adoption, platform efficiency and AI-enabled SDLC transformation. This role will provide technical leadership across Confluent Platform and Confluent Cloud, drive cloud modernization and platform resiliency, and build automation to enhance scalability, security, reliability, performance, stability, and developer productivity. The ideal candidate combines deep Kafka administration expertise with a strong Java development background, hands-on experience in cloud and Kubernetes environments, and the ability to apply AI-assisted engineering to accelerate delivery, improve operational efficiency, and support secure, business-critical solutions at scale.

Key Responsibilities:

  • Design and build AI agents, custom skills, or equivalent frameworks to automate engineering and operational workflows at scale
  • Leverage AI-powered tools (e.g., Copilot, AI agents) to accelerate development, automate testing, improve code quality, and enable intelligent SDLC workflows aligned to AI-DLC vision.
  • Design agentic workflows and multi-agent orchestration patterns to solve complex distributed systems, integration, and operational challenges
  • Act as the senior technical authority for Confluent Platform and Confluent Cloud, providing architecture, design, and implementation guidance to solve complex enterprise integration challenges at scale.
  • Lead solution architecture across cross-functional initiatives, ensuring alignment with cloud modernization, resiliency, security, and AI-driven engineering priorities.
  • Perform deep-dive analysis of complex production issues, drive root cause identification, and implement sustainable remediation strategies with full documentation.
  • Design and build automation frameworks and self-service tools to streamline Kafka operations, reduce manual effort, and improve developer productivity and platform scalability.
  • Lead seamless migration of on-prem Kafka workloads to Confluent Cloud using cluster linking, schema portability, and hybrid streaming patterns—ensuring zero business disruption.
  • Drive execution across Kafka, infrastructure, security, and application teams to remove dependencies, mitigate risks, and ensure on-time delivery of committed milestones.
  • Contribute to enterprise architecture forums, defining and enforcing best practices for event streaming, integration patterns, and platform standardization.
  • Establish best practices for testing, reliability, observability, and operational readiness, ensuring high availability and scalable platform performance.
  • Identify systemic and architectural risks early, leading mitigation efforts to prevent client impact and ensure platform stability.
  • Implement enterprise-grade security controls (mTLS, RBAC, encryption) and drive continuous remediation of vulnerabilities, ensuring compliance with regulatory and audit requirements.
  • Interpret technical requirements to build and enhance Kafka configurations, message flows, and integration solutions supporting business-critical applications.
  • Partner with distributed teams (including offshore engineering) to ensure consistent standards, efficient delivery, and 24x7 operational support across time zones.

What you have

Required Qualifications: Technical Expertise and Educational Requirements

  • Bachelor’s degree in computer science, Engineering, or related field
  • 10+ years of hands-on software engineering experience with proven technical leadership
  • 5+ years of expertise in large-scale distributed systems and mission-critical infrastructure
  • Strong hands-on experience with GitHub Copilot and other AI-assisted development tools, including advanced prompt engineering and workflow integration to accelerate engineering
  • Proven ability to leverage AI-assisted development (e.g., Copilot, code generation) and build AI-driven agents/workflows to improve team productivity and engineering efficiency
  • Deep expertise in Confluent Kafka (capacity planning, administration, internals, performance tuning)
  • Strong experience with Kafka clusters, replication, disaster recovery, and data pipelines
  • Hands-on experience with Kubernetes, Confluent Operator, and cloud-native modernization (GCP)
  • Strong development background on Linux/Unix platforms
  • Experience with data modeling and streaming technologies (Avro, Protobuf, JSON Schema)
  • Strong automation mindset with hands-on expertise in Python, Ansible, and CI/CD pipelines (Jenkins, DevOps tooling) to drive operational efficiency and reduce manual effort
  • Solid foundation in security engineering (encryption, TLS, certificate and key management)
  • Strong focus on observability, reliability, automation, and production readiness with proactive risk mitigation
  • Experience leading architecture and execution across cross-functional, large-scale programs
  • Strong understanding of networking, load balancing, OS fundamentals, and performance optimization
  • Experience in regulated environments (financial services preferred)
  • Strong collaboration skills across engineering, architecture, infrastructure, and business teams
  • Experience working with globally distributed/offshore teams
  • Strong Agile delivery experience (Scrum/Kanban/Scaled Agile)
  • Strong leadership and soft skills including strategic thinking, decision-making, mentoring/coaching, and driving engineering excellence
  • Excellent communication, influencing, and stakeholder management skills, with ability to align diverse teams toward common goals
  • High ownership mindset with ability to prioritize, multitask, and lead through high-pressure production situations
  • Strong problem-solving skills with a proactive, innovation-driven approach
  • Self-driven, adaptable, and customer-focused with strong relationship management and team-building capabilities

Preferred Qualifications: What experience and skills are DESIRED, but are not REQUIRED to perform this role today?

  • Experience applying AI-Driven Development Lifecycle (AI-DLC) practices to modernize SDLC pipelines through intelligent automation, improving development, testing, and release efficiency
  • Demonstrated contributions to architecture standards, reusable frameworks, or open-source initiatives in distributed systems or event-driven platforms
  • Deep expertise in Kafka platform administration and development, including large-scale event streaming systems and platform modernization in enterprise environments
  • Certifications in Confluent Kafka, Confluent Cloud, and major cloud platforms (GCP/AWS/Azure) are a strong plus.

About Charles Schwab

Charles Schwab is a financial services company that provides a full range of securities, brokerage, banking, money management, financial advisory, investor, and retirement plan services. It operates in four main divisions; investing, wealth management, banking, and trading. Charles Schwab provides a full-service brokerage platform that serves individual investors who invest on their own or through a workplace-sponsored retirement or equity plan, as well as banking through Schwab Bank. The firm was founded in 1973 and is headquartered in San Francisco, California.

Charles Schwab Careers

Join the vibrant team at Charles Schwab, a leader in global finance, where your career is propelled by innovation, leadership, and a commitment to diversity and professional growth. At Charles Schwab, we offer more than just job opportunities; we provide a platform for you to make a significant impact on the industry and our clients' lives.

Work You’ll Do

At Charles Schwab, we are dedicated to helping our clients manage their financial futures. Being part of our team means you'll work alongside some of the most skilled professionals in the financial services industry. Our culture thrives on teamwork, integrity, and relentless dedication to our clients. Whether you're looking for a position in financial consulting, technology, or administrative support, Charles Schwab offers a dynamic work environment where your skills will be honed and your achievements recognized.

Innovate and Lead

Embrace the opportunity to lead through innovation. Charles Schwab’s commitment to technology and innovation is fundamental to our service delivery. By joining our team, you will be at the forefront of developing new solutions that redefine the future of finance. Your leadership can guide significant projects that impact our company and the industry.

Grow Your Career

Charles Schwab believes in fostering the growth of its employees. Whether through professional development programs, diversity training, or leadership workshops, we ensure that our team members receive the support and training they need to advance their careers. With a variety of career paths available, your job at Schwab can evolve with your interests and expertise.

Internship and Employment Opportunities

Start your professional journey with Charles Schwab through our internship programs or full-time employment opportunities. We seek individuals who are passionate, curious, and ready to drive change. A career at Schwab is not just about having a job; it's about building a lasting relationship with a company that values your potential.

Benefits and Culture

Charles Schwab is renowned for its employee-friendly culture. We offer a comprehensive benefits package that supports the health, financial stability, and work-life balance of our team members. From competitive salaries and bonuses to health insurance and retirement plans, Schwab ensures that your career is as rewarding as it is enriching.

Networking and Professional Development

Expand your professional network and enhance your skills through our various networking events, mentorship programs, and training sessions. At Charles Schwab, we believe in leveraging collective expertise to foster learning and innovation. Engage with leaders, gain insights from experienced professionals, and build relationships that will aid your career trajectory.

Join Our Team

Explore the numerous career paths available at Charles Schwab and discover how your talents can be utilized to their fullest potential. Search open positions that match your skills and interests. We are continuously hiring across various disciplines and look forward to adding innovative, driven individuals to our team.

Stay Connected

Keep up to date with the latest from Charles Schwab Careers by subscribing to our job alert emails. Tailor your subscription to receive updates that align with your career preferences and be the first to know about new openings, company news, and professional tips.

Explore Charles Schwab Jobs

Ready to take the next step in your career? Visit our careers page to review current job openings, submit your resume, and prepare for your interview. At Charles Schwab, your future is waiting. [SEARCH CHARLES SCHWAB JOBS] Join Charles Schwab today and be part of a team that values diversity, innovation, and leadership—where your career can thrive in the exciting world of finance.
Learn more about Charles Schwab
Size
34,200 employees
Market Cap
$151.6 billion
Industry
Net Income
$3.2 billion
Founded
1973
5 Year Trend
+20%
Revenue
$12.1 billion
NASDAQ

Similar Jobs

More Jobs at Charles Schwab

More Enterprise Technology Jobs

Find similar Senior Kafka Platform Engineer jobs: