ServiceNow

Senior Staff Data Platform Engineer - Kafka - Apache Iceberg - Apache Spark

ServiceNow$181K — $317K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 10+ years in software development with a Bachelor's; 8+ years with a Master's; or 6+ years with a PhD.
  • Strong expertise in distributed systems architecture and design patterns.
  • Deep programming knowledge in Java, including JVM internals.
  • Experience with JVM performance tuning and profiling.
  • Proficient in large-scale distributed system operations.

Responsibilities

  • Architect and build high-performance distributed systems.
  • Design scalable data ingestion solutions with a focus on quality.
  • Deliver high-quality, reusable code while enforcing best practices.
  • Develop foundational tools and libraries emphasizing modularity.
  • Collaborate across teams to refine requirements for end-to-end solutions.
  • Provide technical leadership on complex projects.
  • Research new technologies to enhance platform capabilities.

Benefits

  • Flexible work schedule with a combination of remote and office work.
  • Health plans including flexible spending accounts and a 401(k) with company match.
  • Employee Stock Purchase Plan (ESPP) and matching donations.
  • Flexible time away and family leave programs.
Full Job Description
Job Description

Position Location:
This is a Flexible (Hybrid) position. Flexible positions require 2 days per week in a ServiceNow office location. We have offices in several locations, including San Francisco, CA; Pleasanton, CA; Santa Clara, CA; San Diego, CA

Team Overview

The Data Platform group builds highly scalable, high-performance platform capabilities for data-in-motion and backend storage systems. Our customers operate at massive scale, pushing the boundaries of data volume, throughput, and concurrency. We are looking for a seasoned IC5 Senior Staff Engineer with deep expertise in distributed systems, data ingestion pipelines, and Data Lake architectures to drive next-generation platform innovation.

Role Summary

As an IC5 Senior Staff Engineer, you will architect and deliver large-scale distributed platform components, lead complex technical initiatives, and define engineering best practices. You will bring strong leadership, hands-on engineering depth, and the ability to design and operate reliable, scalable, and high-performance data systems.

What you get to do in this role:
  • Architect, design, and build high-performance distributed systems and platform components.
  • Build distributed systems data ingestion solutions with strong emphasis on scalability, quality, and operational excellence.
  • Design software that is easy to use, extend, and customize for customer-specific environments.
  • Deliver high-quality, clean, modular, and reusable code while enforcing engineering best practices (code reviews, unit testing, automation, design reviews).
  • Build foundational libraries, frameworks, and tools focused on modularity, extensibility, configurability, and maintainability.
  • Collaborate across engineering teams to refine requirements and deliver end-to-end solutions.
  • Provide technical leadership for projects with significant complexity and risk.
  • Research, evaluate, and adopt new technologies that enhance platform capabilities.
  • Troubleshoot and diagnose complex production issues across distributed systems.


Qualifications

To be successful in this role you have:
  • Experience leveraging or critically thinking about how to integrate AI into engineering work - whether using AI-powered coding and operational tooling, automating workflows, or reasoning about how AI changes the way software and infrastructure are built.
  • 10+ years of software development experience with a Bachelor's degree; OR 8+ years with a Master's degree; OR 6+ years with a PhD OR equivalent work experience.

Core Distributed Systems Expertise
  • Strong fundamentals in distributed systems architecture, design patterns, and algorithms.
  • Deep programming expertise in Java, including JVM internals, memory models, and garbage collection.
  • Proven experience in JVM performance tuning, profiling, and diagnosing performance bottlenecks.
  • Strong understanding of concurrency, networking, sockets, OS internals, and performance optimization.
  • Hands-on experience building and operating large-scale distributed systems.
  • Experience with relational databases such as Oracle, MySQL, or PostgreSQL.

Streaming & Messaging Systems
  • Experience with large-scale deployments of Kafka, or similar streaming platforms.
  • Deep knowledge of stream processing, topic design, partitioning, replication, and HA strategies.
  • Experience working within DevOps environments for operationalizing distributed platforms.
  • Demonstrated experience architecting and delivering full-stack Data Lake solutions.
  • Strong expertise in designing and operating data ingestion pipelines using:
    • Apache Iceberg (tables, catalogs, schema evolution, metadata management)
    • Kafka Connect (source/sink connectors, distributed mode)
    • Apache Kafka (high-scale clusters, topic/partition strategies, HA)
    • Apache Flink (stateful stream processing, exactly-once semantics)
    • Apache Spark (batch & streaming jobs, optimization, partitioning)
  • Expertise in data formats such as Parquet, ORC, and Avro, along with compaction and governance strategies.
  • Ability to build scalable, fault-tolerant ingestion and transformation workflows.
  • Experience integrating Data Lakes with analytics engines, query services, or ML platforms.


For positions in this location, we offer a base pay of $181,200 - $317,100, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies, and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs. Compensation is based on the geographic location in which the role is located and is subject to change based on work location.

Additional Information

Work Personas

We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.

About ServiceNow

ServiceNow provides cloud-based solutions that define, structure, manage, and automate services for enterprise operations in North America, Europe, the Middle East, Africa, the Asia Pacific, and other countries. The company offers service management solutions, including incident, problem, change, request, and cost management as well as service catalogs; and IT, HR, facilities, and field service management solutions. It also provides IT operations management solutions covering service mapping, delivery, and assurance solutions; business management solutions such as financial management, project portfolio suite, vendor performance management, and performance analytics as well as governance, risk, and compliance; and application development services.

ServiceNow Careers

Join the dynamic team at ServiceNow, a global leader in digital workflow solutions, where innovation and leadership converge to shape the future of work. At ServiceNow, we offer more than just job opportunities; we provide a platform for professional growth and a chance to be part of a culture that values diversity, creativity, and continuous learning.

Work You’ll Do

Embark on a career journey with ServiceNow and contribute to the world’s leading enterprises' digital transformation. Our team is at the forefront of developing cutting-edge technologies that improve how people work. With ServiceNow, you will use your skills to impact businesses and industries profoundly, driving efficiency and innovation.

Join Our Market-Leading Team

ServiceNow is not just another technology company. We are a team that thrives on diversity and leadership, fostering an inclusive environment that promotes growth and development. Our commitment to diversity training ensures that every team member can achieve their potential.

Innovative Work

ServiceNow is home to more than 10,000 dedicated professionals who lead the charge in digital workflows and enterprise solutions. As part of our team, you will engage in projects that merge technology with practical applications, creating revolutionary products that advance how services are delivered and managed.

Career Development

At ServiceNow, your career trajectory is filled with boundless opportunities. We support your growth with robust training programs, leadership development courses, and access to global challenges. Whether you are looking for an internship, full-time position, or leadership role, ServiceNow equips you with the tools to excel.

Be Part of a Great Team

Working at ServiceNow means being part of a community that values teamwork and innovation. Our collaborative environment encourages networking and sharing ideas, making our workplace vibrant and dynamic. The benefits of joining ServiceNow extend beyond comprehensive health and wellness; they include fostering professional connections and friendships that last a lifetime.

Explore Job Opportunities and Internships

Whether you’re a seasoned professional or a recent graduate, ServiceNow offers a range of employment options to suit your career goals. From internships that provide real-world experience to full-time positions that challenge you to leverage your expertise, we are committed to hiring the best talent.

Stay Connected

Join Our Team Search open positions that match your skills and interests. At ServiceNow, we look for passionate, curious, and solution-driven team players. Explore the possibilities that await you at a company that is committed to your professional success.

Keep Up to Date

Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work here.

Job Alert Emails

Customize your subscription to receive job alerts, the latest news, and insider tips tailored to your preferences. Discover the exciting and rewarding career opportunities that await at ServiceNow.

ServiceNow Careers

Empowering professionals to achieve more, ServiceNow is where careers are future-proofed, and ambitions are realized. Join us in our journey of growth and innovation.
Learn more about ServiceNow
Size
16,881 employees
Market Cap
$76.5 billion
Industry
Net Income
$118.5 million
Founded
2004
5 Year Trend
+33.5%
Revenue
$4.5 billion
NASDAQ

Similar Jobs

More Jobs at ServiceNow

More Information Technology Jobs

Find similar Senior Staff Data Platform Engineer - Kafka - Apache Iceberg - Apache Spark jobs: