Cloudera

Principal Software Engineer - Spark

Cloudera$270K — $320K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's degree in Computer Science or related field
  • Over 10 years of experience as a Software Engineer in data infrastructure
  • Strong proficiency in programming languages such as Java, Scala, C++, Python, or GoLang
  • Deep knowledge of distributed data processing systems and cloud-native architectures
  • Excellent communication and team collaboration skills
  • Experience with containerization technologies like Kubernetes and Docker
  • Familiarity with cloud services (AWS, Azure, GCP) or private cloud solutions

Responsibilities

  • Drive the multi-year technical roadmap for Cloudera Data Engineering
  • Acquire deep technical knowledge of Spark, Airflow, and Iceberg technologies
  • Mentor engineering teams through design reviews and architectural guidance
  • Collaborate with product and engineering teams to deliver key features
  • Develop solutions for large-scale production clusters of hundreds to thousands of nodes
  • Maintain a focus on programming quality and clean coding practices

Benefits

  • Generous Paid Time Off (PTO) policy
  • Support for work-life balance
  • Flexible Work From Home (WFH) policy
  • Programs promoting mental and physical wellness
  • Reimbursement for phone and internet costs
  • Access to continued career development opportunities
  • Comprehensive benefits and competitive package
  • Participation in Employee Resource Groups
Full Job Description

Business Area:

Engineering

Seniority Level:

Director

Job Description:

Cloudera Data Engineering is the next-generation cloud-native service that helps our customers run large-scale data engineering workflows made up of industry-standard big data processing frameworks like Apache Spark, Apache Airflow, Iceberg with just a few clicks, across both on-premises and public cloud environments.

is a next-generation cloud-native service that enables customers to run large-scale data engineering workflows using industry-standard big data technologies such as Apache Spark, Apache Airflow, and Apache Iceberg  with just a few clicks across both on-premises and public cloud environments.

We are seeking a Principal Staff Engineer with a strong technical background in the data infrastructure space to lead the Cloudera Data Engineering experience for all customers using Cloudera Data Engineering Spark, Airflow, and Lakehouse. This high-impact IC role offers the opportunity to shape the future of Cloudera’s Data Engineering and Lakehouse  products across multiple cloud environments, impacting thousands of customers worldwide.

This role is not eligible for immigration sponsorship or relocation.

As a Principal Software Engineer you will:

  • Drive the multi-year technical roadmap and architectural vision for Cloudera Data Engineering.

  • Gain deep technical knowledge across the data services technical stack, with a focus on Spark, Airflow, Iceberg, and apply this expertise in your daily work.

  • Foster engineering excellence through technical mentorship, design reviews, and architectural guidance.

  • Collaborate with product, engineering, and cross-functional partners, leading the delivery of several large, critical features in Cloudera’s data engineering experience.

  • Work on large-scale distributed systems, ranging from hundreds to thousands of nodes in production clusters.

  • Bring passion for programming, clean coding practices, attention to detail, and a strong focus on quality.

We are excited about you if you have:

  • Relevant studies / BS or MS in Computer Science or related field

  • 10+ years of experience as a Software Engineer in the data infrastructure space

  • Strong understanding of at least one of the following languages: Java, Scala, C++, Python, GoLang. And interested to learn the languages we’re using.

  • Passionate about programming, clean coding habits, attention to detail, and focus on quality

  • Deep expertise in distributed data processing systems and cloud-native architectures.

  • Excellent communication and collaboration skills

  • Experience with containerization (Kubernetes, Docker).

  • Experience with using/developing Apache Spark/Airflow or other related technologies.

  • Experience with public cloud (AWS/Azure/GCP) and/or private cloud (OpenShift/Rancher)

  • (Most importantly) An open-minded attitude, desire to learn new things and build great products

You might also have…

  • Contributed to open-source projects.

  • Strong understanding of modern Lakehouse architectures, open table formats, and metadata/catalog services.

  • Experience with large-scale, distributed systems design and development with an understanding of scaling, performance, and scheduling.

  • Solid experience with at least one cloud service (AWS, Azure, GCP, OpenShift)

The expected base salary range for this role in California is $270 - $320k

The salary will vary depending on your job-related skills, experience and location

What you can expect from us:

  • Generous PTO Policy 

  • Support work life balance with

  • Flexible WFH Policy 

  • Mental & Physical Wellness programs 

  • Phone and Internet Reimbursement program 

  • Access to Continued Career Development 

  • Comprehensive Benefits and Competitive Packages 

  • Employee Resource Groups

About Cloudera

Cloudera is a software company that provides a unified platform for data management and analytics. The company's platform enables organizations to store, process, and analyze large amounts of data in a variety of formats, including structured, semi-structured, and unstructured data. Cloudera's platform is used by some of the world's largest and most innovative organizations, including Airbus, Credit Suisse, and Expedia. The company was founded in 2008 and is headquartered in Palo Alto, California.
Learn more about Cloudera
Size
2,728 employees
Market Cap
$4.6 billion
Industry
Net Income
-$162.7 million
Founded
2008
5 Year Trend
+39.2%
Revenue
$869.2 million
NASDAQ

Similar Jobs

More Jobs at Cloudera

More Enterprise Technology Jobs

Find similar Principal Software Engineer - Spark jobs: