Introduction
Your role and responsibilities
Join us in building the next generation of Confluent Cloud, shaping how the world builds data systems. We help organizations put data in motion: capturing, transporting and transforming it to meet the growing demand for real-time information. Our team builds the elastic compute fabric behind Confluent Cloud, including the workloads that power its AI and data streaming products. The product teams describe what they need, and the platform decides where it runs, how it scales and how it stays up. It handles placement, safe rollouts, identity and failure recovery across many Kubernetes clusters and multiple clouds, so no one has to think about individual clusters, zones or clouds. As a Principal Engineer, you will set the technical direction for this platform and lead the cross team efforts that bring it to life. Youll work on problems like keeping workloads running through a zone or Kubernetes cluster failure, moving live production services onto the platform without customer impact, and making new product launches faster.
What youll do
• Set and communicate a long-term technical vision for the Confluent Cloud compute platform, partnering across the company with engineering and product leadership to influence strategy and architecture
• Lead large, cross-organizational projects from design to delivery, including migrating live production workloads onto the platform, while staying hands-on with our code and systems
• Define the core platform APIs and their contracts, and evolve them safely while many services depend on them
• Guide the design of key platform capabilities: placement and scheduling across zones and clusters, capacity and quota, progressive and automated rollouts, and survival of zone and cluster failures
• Raise the bar for quality, availability, resilience and scalability, and drive improvements to our development and operational processes
• Be a voice for, and model, the effective and responsible use of AI throughout the development lifecycle
• Coach and mentor engineers and technical leaders, and foster a supportive engineering culture
Required education
Bachelors Degree
Preferred education
Masters Degree
Required technical and professional expertise
• 10+ years of software engineering experience, with at least 5 years building infrastructure platforms, control planes or large-scale distributed systems
• Deep Kubernetes expertise in Go (or Java, with a willingness to work in Go), including building operators, controllers and custom resources, not only deploying to clusters
• Experience designing declarative APIs where users state intent and the system reports status, and evolving them compatibly while in production use
• Strong distributed systems grounding (failure domains, capacity, graceful degradation) and operational ownership, from on-call to turning incidents into lasting reliability improvements
• A track record of owning a platforms architecture end to end and leading multi-quarter, cross-team efforts to adoption, influencing without formal authority
• Experience with one or more of: schedulers or placement systems, progressive delivery and rollout engines, multi-cluster or multi-cloud operations
Preferred technical and professional experience
• Experience running or building platforms for stateful workloads such as databases or data streaming systems
• Familiarity with fleet and multi-cluster tooling (Cluster API, Karmada, Crossplane, Argo CD or Flux at scale)
• Experience with multi-tenant quota, priority, preemption and cost attribution
• Knowledge of newer upstream Kubernetes capabilities such as in-place pod resize, native sidecars and workload-aware scheduling
• Experience with workload identity, certificates and secrets (for example SPIFFE, cert manager)
• Open-source contributions to Kubernetes or related projects, or conference talks and publications
• Experience applying AI to engineering and operational toil across a large fleet
OTHER RELEVANT JOB DETAILS
IBM offers a competitive and comprehensive benefits program. Eligible employees may have access to:
- Healthcare benefits including medical & prescription drug coverage, dental, vision, and mental health & well being
- Financial programs such as 401(k), cash balance pension plan, the IBM Employee Stock Purchase Plan, financial counseling, life insurance, short & long- term disability coverage, and opportunities for performance based salary incentive programs
- Generous paid time off including 12 holidays, minimum 56 hours sick time, 120 hours vacation, 12 weeks parental bonding leave in accordance with IBM Policy, and other Paid Care Leave programs. IBM also offers paid family leave benefits to eligible employees where required by applicable law
- Training and educational resources on our personalized, AI-driven learning platform where IBMers can grow skills and obtain industry-recognized certifications to achieve their career goals
- Diverse and inclusive employee resource groups, giving & volunteer opportunities, and discounts on retail products, services & experiences
We consider qualified applicants with criminal histories, consistent with applicable law.
This position was posted on the date cited in the key job details section and is anticipated to remain posted for 21 days from this date or less if not needed to fill the role.
The compensation range and benefits for this position are based on a full-time schedule for a full calendar year. The salary will vary depending on your job-related skills, experience and location. Pay increment and frequency of pay will be in accordance with employment classification and applicable laws. For part time roles, your compensation and benefits will be adjusted to reflect your hours. Benefits may be pro-rated for those who start working during the calendar year.