Qualifications

• Experience with Apache Iceberg, Spark, Flink, Kafka, dbt, Trino, Snowflake, and Databricks.
• Proficiency in cloud services such as AWS, Azure, or Google Cloud.
• Strong programming skills in Python, Scala, SQL, and Java.
• Familiarity with containerization and orchestration using Kubernetes and Docker.
• Knowledge of infrastructure automation with Terraform and workflow management with Airflow, Dagster, or Prefect.
• Understanding of data cataloging tools like Polaris, Unity Catalog, Glue Catalog, and Apache Nessie.

Responsibilities

• Define enterprise lakehouse architecture and governance standards.
• Design and build data layers using Apache Iceberg.
• Develop frameworks for data ingestion from various sources and formats.
• Create scalable data pipelines utilizing Spark, Flink, Kafka, and SQL.
• Implement comprehensive metadata management and data quality protocols.
• Optimize data processes for improved performance and efficiency.
• Enable features for AI integration and advanced analytics workloads.

Benefits

• Discretionary Annual Incentive.
• Comprehensive medical coverage including health, dental, and vision.
• Support for family leave including maternal and parental leaves.
• Insurance options such as auto, home, and identity theft protection.
• Benefits for professional development and commuting costs.
• Generous time off policies including vacation and sick leave.
• Legal and financial assistance programs, including 401K and student loan refinancing.