The Data Tooling team builds and operates the shared platforms and developer tools that Redfin's engineers, analysts, and data scientists use to build, schedule, discover, and run data pipelines. We own a multi-tenant Airflow platform on Kubernetes, along with the integrations, runtimes, and services around it.
Our customers are other engineering, analytics, and machine learning teams across Redfin and Rocket. We focus on making the paved road the easy road: self-service onboarding, reliable orchestration, automatic monitoring and alerting, and a cost-efficient platform that teams can trust with their most critical workflows.
Data Tooling is leading the shift for AI-native development in data engineering. We are building tools, skills, and agents that allow rapid implementation and iterations of production workflows, and that answer and diagnose common platform issues on their own, so every data team at Redfin can ship faster with higher quality.
About the Role- Own the architecture and evolution of our Airflow platform, which runs the production batch workflows behind ML, analytics, and product data across the company.
- Lead the design and delivery of platform features end to end, for supporting new technologies, new data delivery integrations, and beyond, from technical design through rollout and adoption.
- Drive AI-native data engineering at Redfin: build the tools, skills, and development environments that let engineers prototype and iterate on production pipelines quickly, and turn what we learn into reusable modules for other teams.
- Build AI-powered support and self-service experiences to help answer common engineering questions and diagnoses common failures, reducing on-call load and giving users faster answers.
- Lead Redfin's data discovery and metadata efforts by owning data catalog connectors and metadata ingestion across a variety of data stores, delivering a unified view of data and lineage across the platform.
- Raise the bar on reliability, observability, and cost efficiency across our platforms, including right-sizing compute, spot and autoscaling strategies, infrastructure as code, and retiring legacy systems and infrastructure once migrations are complete.
About You- You are an experienced developer with 5+ years of experience building and operating data platforms, developer tooling, or large-scale distributed systems.
- You have deep experience with workflow orchestration and running production platforms in the cloud. We use Python, Java, Airflow, Kubernetes, Helm, Terraform, Docker, Snowflake, dbt, Spark, Postgres, Kafka, and Datadog in AWS.
- You treat internal engineers as customers: you have built self-service platforms, SDKs, or tools that other teams depend on, and you care about developer experience, documentation, and adoption.
- You have hands-on experience with AI coding agents and LLM-based tools, and you are excited to help define how a data team builds, tests, and supports pipelines in an AI-native way.
- You have owned production systems with a focus on reliability, observability, and cost, and you know how to reduce operational toil through automation.
- You're curious and a life-long learner: you're willing to take risks and champion new ideas.
- You will exercise thought leadership in designing, architecting, and implementing solutions for difficult challenges faced by your partner teams.
- You are a teacher and a mentor: you have the leadership skills (and the patience) to improve the developers around you.
- You live and breathe a culture of quality data, service to customers, operational partners and teammates.
- Above all, you share a passion for our mission to create a fundamentally better real estate experience for our customers.
What you'll getOur team members fuel our strategy, innovation and growth, so we ensure the health and well-being of not just you, but your family, too! We go above and beyond to give you the support you need on an individual level and offer all sorts of ways to help you live your best life. We are proud to offer eligible team members perks and health benefits that will help you have peace of mind. Simply put: We've got your back. Check out our full list of Benefits and Perks.
On-Call ExpectationsThis role may include participation in an on-call rotation to support production systems and ensure service reliability. On-call responsibilities may include coverage during nights and weekends. If applicable, frequency and scheduling will be determined by team needs and communicated accordingly.