Summary:We are looking for an Associate Data Engineer to join our team at Cosm. The successful candidate will be responsible for building and managing data pipelines that power business operations for Cosm Venues. The candidate will use our data platform, built on Databricks and AWS, to implement incremental data flows and efficiently join and transform both internal and external data sources. The ideal candidate will have experience using industry-standard tools and a strong drive to learn new techniques. We expect all our engineers and managers to be versatile, display leadership qualities, and be enthusiastic when taking on new problems as we launch our venues and push technology to new heights.
Responsibilities:- Build and manage incremental, near real-time data pipelines
- Work with data users, analysts, and other consumers to deliver accurate, timely datasets
- Work on end to end integration with internal and external data sources and consumers
- Ensure the data team is following best practices while building our data catalog, including code maintainability, data quality, and documentation
- Learn and apply state of the art techniques for managing complex workflows, like incremental data flow
- Foster a data driven culture by bringing your unique perspective to a dynamic work environment
Experience:- Bachelor's in Computer Science, Information Technology, or a related field, or relevant work experience.
- 0-2 years developing data systems
- Experience with critical systems that have significant impact on business operations
- Expertise in Apache Spark, specifically the DataFrame API. We use both the Python and SQL interfaces
- Knowledge of incremental data flow or Medallion Architecture
- Exposure to Databricks Platform, including its integration with AWS infrastructure
- Past work with a Product Analytics tool (i.e., PostHog, Mixpanel, etc.) is a plus
- Demonstrated drive to learn new concepts
The annualized base salary range for this position in California is $75,000- $90,000. The base salary offered will factor in internal equity and may also vary depending on the candidate's geographic region, job-related knowledge, skills, and relevant experience, among other factors.
All applicants must be at least 18 years of age at the time of employment. This requirement is in accordance with applicable federal, state, and local labor laws.
