Role Overview:This is an onsite Lead Spark Scala Engineer role based in Austin, TX, requiring prior Apple experience. The position focuses on building and managing large-scale data platforms, emphasizing data analytics, transformation, and governance within distributed systems.
Key Responsibilities:- Drive the team's execution on status reporting, roadmap reviews, quarterly engineering reviews, and newsletters.
- Handle fast-paced and ambiguously defined projects with multiple customers and partners.
Required Skills:- Strong experience in Apache Spark with Scala.
- Proficiency in building and working on Spark applications with Scala data frame APIs.
- Knowledge of Cloud AWS/S3, Iceberg, and Git.
- Strong SQL and data modelling skills.
- Experience with building and managing applications for large-scale data platforms, including storage, computing aspects, data ingestion, governance, data management, and performance.
- Skilled at troubleshooting complex issues in large-scale distributed systems.
- Strong understanding of technical concepts, Spark, and Scala (big data technology).
- Strong strategic thinking, project management, and communication skills.
- Ability to analyze and understand data and data analytics, focusing on data meaning, transformation, and the impact of changes on analytics or metrics.
Qualifications:- 6-8 years of experience.
- Must have prior Apple experience.
Preferred Skills:- Familiarity with using a Mac laptop.
