Senior Data Engineer - Zonda - Irvine, CA
Job Description
Senior Data Engineer - Zonda - Irvine, CA
Job Description
The Senior Data Engineer is responsible for designing, building, and operating reliable, scalable data pipelines and data products across a modern cloud data platform.
This is a hands-on engineering role focused on data pipeline development, performance optimization, production reliability, and continuous improvement. The Senior Data Engineer will independently own complex data engineering work from requirements through production and ensure solutions are maintainable, testable, observable, and performant.
Responsibilities:- Design, build, test, and maintain reliable, scalable data pipelines and data products.
- Develop and optimize data transformations and orchestrations using SQL, Python, dbt, Airflow, Glue, PostgreSQL, and Snowflake.
- Translate business requirements into maintainable technical designs and production-ready solutions.
- Implement automated testing, data-quality checks, monitoring, failure handling, and recovery.
- Optimize large-scale data workloads for performance, scalability, and cost.
- Troubleshoot production issues and perform root-cause analysis across pipelines and databases.
- Follow Git-based development, code review, CI/CD, and controlled release practices.
- Ensure data products are documented, observable, governed, and supported by appropriate metadata and lineage.
- Reduce technical debt, manual processes, and recurring operational issues through automation and improved design.
- Collaborate with Product Management, Application Engineering and business stakeholders.
Basic Qualifications:- 6+ years of professional experience in data engineering or a closely related discipline.
- Strong Python development skills for data pipelines, automation, integrations, and supporting data applications.
- Advanced SQL skills and experience working with large-scale datasets.
- Strong understanding of data modeling, database design, and data transformation patterns.
- Experience with dbt, including model development, dependency management, testing, incremental processing, and production deployment.
- Experience with Airflow, including DAG development, orchestration, dependencies, retries, failure handling, scheduling, and production operations.
- Hands-on PostgreSQL experience, including complex SQL development, database design, indexing, query optimization, and performance tuning.
- Hands-on Snowflake experience in production data workloads context.
- Experience working with AWS data services such as S3, RDS/Aurora, Glue, MWAA, IAM, and CloudWatch.
- Experience implementing automated data validation and quality controls.
- Experience with Git, pull requests, code review, conflict resolution and CI/CD workflows.
- Demonstrated ability to troubleshoot complex production pipeline and data issues.
- Understanding of monitoring, failure recovery, and production support practices.
Preferred Qualifications:- Experience with Amazon Aurora PostgreSQL.
- Experience working with datasets containing hundreds of millions or billions of records.
- Experience with AWS Glue and Amazon MWAA.
- Experience with geospatial data and PostGIS.
- Experience with SQL Server.
- Experience with DataHub or another metadata, lineage, or governance platform.
- Experience with Grafana or comparable observability tooling.
- Experience with database schema migration and version-control frameworks.
- Experience working within controlled production release and change-management processes.
- Strong hands-on engineering capability and ownership.
- Ability to independently deliver complex data engineering solutions.
- Strong analytical, troubleshooting, and root-cause-analysis skills.
- Ability to work effectively with large and complex datasets.
- Strong focus on reliability, performance, scalability, and maintainability.
- Ability to balance delivery requirements with engineering quality.
- Strong written and verbal communication.
- Ability to collaborate effectively with technical and non-technical stakeholders.
What's in it for you?When you join CoStar Group, you'll experience a collaborative and innovative culture working alongside the best and brightest to empower our people and customers to succeed.
We offer you generous compensation and performance-based incentives. CoStar Group also invests in your professional and academic growth with internal training and tuition reimbursement.
- Our benefits package includes (but is not limited to):
- Comprehensive healthcare coverage: Medical / Vision / Dental / Prescription Drug
- Life, legal, and supplementary insurance
- Virtual and in person mental health counseling services for individuals and family
- Commuter and parking benefits
- 401(K) retirement plan with matching contributions
- Employee stock purchase plan
- Paid time off
- Tuition reimbursement
- On-site fitness center and/or reimbursed fitness center membership costs (location dependent)
- Access to CoStar Group's Employee Resource Groups
- Complimentary gourmet coffee, tea, hot chocolate, fresh fruit, and other healthy snacks
The final salary or hourly rate offered for this role will fall within the range set forth below based on a variety of factors, including but not limited to, geographic location, skills, and competencies.
Base Compensation: $128,000- $190,000 (Annually)
We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position.