This role requires a hybrid schedule and will be based in our Santurce, PR office (Tuesday through Thursday) and work fully remotely on Mondays and Fridays each week.Red Ventures Education is looking for a Senior Data Engineer to help build, maintain, and strengthen the data platform that powers analytics, reporting, and decision-making across our education platforms.
In this role, you'll own and improve production data pipelines, develop analytics-ready data models, and partner closely with analytics, product, platform, and security teams to deliver reliable, scalable, and well-governed data solutions. You'll work in a modern lakehouse environment built on Databricks, AWS, Python, SQL, and Terraform, with a focus on performance, data quality, governance, and long-term maintainability.
This is a hands-on, full-time role based in our Puerto Rico office for a senior engineer who is comfortable taking ownership of critical pipelines, improving platform standards, and helping teams turn trusted data into measurable business impact.
What You'll Do:- Build, maintain, and optimize batch ETL/ELT pipelines in Databricks using Python and SQL.
- Support day-to-day production pipeline operations, including monitoring, troubleshooting failures, managing backfills, and performance tuning.
- Develop and maintain analytics-ready data models that support reporting, dashboards, and business insights.
- Partner with analytics, BI, product, and business stakeholders to align data definitions and deliver scalable data solutions.
- Integrate third-party data sources and APIs into the platform, ensuring clean ingestion, transformation, validation, and documentation.
- Implement and maintain data quality checks, validation logic, observability practices, and operational documentation.
- Support BI and reporting tools such as Tableau, Looker, or similar platforms by ensuring underlying data tables are performant, trusted, and well-modeled.
- Help optimize Databricks workloads for reliability, scalability, performance, and cost efficiency.
- Contribute to infrastructure-related work for data pipelines, including Terraform-managed resources and environment configuration.
- Work with platform and security teams on Databricks governance, identity and access management, Unity Catalog registration, ownership, and permissions.
- Participate in code reviews and contribute to engineering standards, CI/CD practices, and collaborative development workflows.
- Support data migration and platform improvement efforts that move datasets and pipelines into production-grade environments
What We're Looking For:- Required:
- 5+ years of professional data engineering experience designing, building, and operating production data solutions.
- Hands-on experience with Databricks, Spark, and cloud-based data platforms, preferably AWS.
- Strong SQL skills and proficiency in Python or Scala for building reliable, performant data pipelines.
- Experience building and maintaining batch ETL/ELT pipelines in production environments.
- Strong understanding of data modeling for analytics, including fact/dimension-style schemas and semantic-layer support.
- Experience debugging, monitoring, backfilling, and tuning production data pipelines.
- Working knowledge of infrastructure-as-code, particularly Terraform, as it applies to data platforms.
- Familiarity with CI/CD, Git, GitHub, pull requests, code reviews, and collaborative engineering workflows.
- Experience with Databricks Unity Catalog, including table registration, ownership, grants, and permission management.
- Understanding of data governance, identity and access management, role-based access control, and service principals.
- Ability to communicate clearly with technical and non-technical stakeholders.
- Collaborative mindset and experience working across analytics, product, platform, and business teams.
- Preferred:
- Experience supporting BI and analytics platforms such as Tableau, Looker, or similar tools.
- Familiarity with Delta Lake and governed lakehouse environments.
- Exposure to dbt or other SQL-based transformation frameworks.
- Experience integrating third-party data sources and external APIs into data platforms.
- Experience with AWS services such as S3, EC2, Lambda, IAM, or related cloud infrastructure.
- Background working with consumer-facing, content-driven, education, media, or digital platform data.
- Experience supporting privacy-safe data sharing patterns, secure data exchange, or clean-room environments.
Compensation: Actual compensation varies based on location, experience, and qualifications.
Additionally, the following benefits are provided by Red Ventures, subject to eligibility requirements.
- Health Insurance Coverage (medical, dental, and vision)
- Life Insurance
- Short and Long-Term Disability Insurance
- Holiday Pay
- 401(k) with match
- Paid Parental Bonding Benefit Program
- Flexible Paid Time Off (PTO): We believe time to rest and recharge is essential. That's why we offer a generous and flexible PTO policy. Full-time employees accrue 20 days of PTO for a full calendar year annually, with an increase to 25 days after five years of service.