Google

Senior Software Engineer, Managed Spark, OpenSource

Google$174K — $252K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree or equivalent practical experience.
  • 5 years designing, analyzing, and troubleshooting large distributed systems.
  • 5 years programming in Java, C, or Golang.
  • Experience with Spark, Hive, or similar engines.
  • Experience in benchmarking and crafting custom benchmarks.
  • Experience developing cloud or SaaS products.

Responsibilities

  • Build customer-facing features for Managed Service for Apache Spark in the cloud.
  • Drive design and execution for performance and lakehouse enhancements.
  • Enhance Apache Spark and lakehouse technologies for performance and reliability.
  • Contribute to documentation and educational content based on updates and feedback.
  • Review code by peers to ensure quality and efficiency.

Benefits

  • Health, dental, and vision insurance.
  • Paid time off and holidays.
  • Retirement savings plan options.
  • Professional development opportunities.
  • Flexible work hours and remote work options.
Full Job Description
Minimum qualifications:
  • Bachelor's degree or equivalent practical experience.
  • 5 years of experience designing, analyzing and troubleshooting large-scale distributed systems.
  • 5 years of programming experience in Java, C or Golang.
  • Experience developing with Spark, Hive, or similar engines.
  • Experience in benchmarking and building custom benchmarks.
  • Experience in developing cloud or software as a service (SaaS) products.

Preferred qualifications:
  • Master's degree or PhD in Computer Science or a related technical field.
  • Experience with Data lakes like Apache Iceberg, Apache Hudi, Delta lake etc.
  • Experience with Database optimizations - query and executor optimizations.
  • Experience working with data science tools such as Jupyter notebooks.
  • Experience with Open Telemetry, JMX and other monitoring solutions.
  • Contributions to Apache or other similar open-source projects such as Iceberg, Delta, Hudi, Spark, Presto, Flink etc.


Responsibilities
  • Build customer-facing features for Managed Service for Apache Spark (formerly Dataproc) to run Spark in the cloud.
  • Drive technical design and execution for performance and lakehouse features and enhancements.
  • Enhance Apache Spark and lakehouse technologies like Iceberg or Delta Lake for performance, reliability, security, and monitoring.
  • Contribute to documentation or educational content based on product updates and user feedback, and extend open-source technologies like Apache Spark, Flink, Hive, and Trino to improve debuggability, observability, and supportability.
  • Review code developed by other developers and provide feedback to ensure style guidelines, code check-in, accuracy, testability, and efficiency.

About Google

Google is a multinational technology company that specializes in Internet-related services and products. These include online advertising technologies, search engine, cloud computing, software, and hardware. Google was founded in 1998 by Larry Page and Sergey Brin while they were Ph.D. students at Stanford University. The company has grown tremendously since then and has become one of the most valuable companies in the world. Google's mission is to organize the world's information and make it universally accessible and useful.
Learn more about Google
Size
156,500 employees
Market Cap
$1,115.4 billion
Industry
Net Income
$40.2 billion
Founded
1998
5 Year Trend
+23.3%
Revenue
$182.5 billion
NASDAQ

Similar Jobs

More Jobs at Google

More Information Technology Jobs

Find similar Senior Software Engineer, Managed Spark, OpenSource jobs: