As a Senior Data Engineer, you will share ownership of Redfin's Data Platform, owning business critical data integrations and operational excellence. You will work closely with Engineering and Analytics teams to create and support data pipelines and transformations. The ideal candidate is a data pipeline builder who enjoys optimizing existing systems as well as building new systems from the ground up. We are also looking for someone who is self-directed and comfortable supporting the data needs of multiple systems and teams.
The Role- Design, develop, and support complex data pipelines from a wide variety of data sources for Redfin
- Work with other Engineering teams to design and implement data exchange systems from structured and unstructured data sources
- Work with end users to gather requirements and design solutions that provide the the data they need in the format they need it in
- Ensure 100% accuracy in everything you do - make sure that all code and processes are fully tested and verified before running in production
- Identify and implement internal process improvements by automating manual processes and optimizing for accuracy, performance and coding best practices
- Support and maintain dev / test / prod environments
- Serve as part of weekly on call rotation
About You- 5+ years experience with a modern programming language (Python, Java, etc). Python is preferred
- 5+ years experience with complex SQL, data modeling and database technologies (Postgres, MySQL, Snowflake, etc). Snowflake is preferred
- Experience creating and maintaining complex data pipelines
- Ability to translate business needs into technical requirements
- Experience with batch and streaming data pipelines
- Experience with both structured and unstructured data sets
- Ability to structure data to make it accessible, performant, and resilient to change
- Experience with Git / Jenkins / Airflow / Docker / Kubernetes / Spark is a plus
- Experience with message queuing and stream processing data is a plus
- Ability to handle ambiguity and function in a fast paced, constantly changing environment
- Ability to communicate well with both technical and non technical users
What you'll getOur team members fuel our strategy, innovation and growth, so we ensure the health and well-being of not just you, but your family, too! We go above and beyond to give you the support you need on an individual level and offer all sorts of ways to help you live your best life. We are proud to offer eligible team members perks and health benefits that will help you have peace of mind. Simply put: We've got your back. Check out our full list of Benefits and Perks.
This job description is an outline of the primary responsibilities of this position and may be modified at the discretion of the company at any time.
