Data Engineer

YOU.com

$180K — $220K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 6+ years of data engineering experience
  • Strong hands-on experience with Databricks, AWS, and Kafka
  • Proficient in Python (PySpark) and SQL for data processing
  • Experience building and maintaining ETL/ELT pipelines
  • Familiarity with reverse ETL workflows and syncing data to tools
  • Exposure to AI/ML data pipelines and architectures
  • Strong problem-solving and collaboration skills

Responsibilities

  • Build and maintain scalable data pipelines using Databricks and AWS
  • Develop clean analytics layers from source systems like Salesforce
  • Design and optimize ETL/ELT workflows using DBT and PySpark
  • Collaborate with finance to create metrics and forecasting models
  • Partner with marketing to enable data for campaigns and analytics
  • Support AI-driven applications by preparing datasets for integrations
  • Monitor data pipeline performance and ensure quality through validations

Benefits

  • Hubs in San Francisco and New York City for co-working and gatherings
  • Flexible PTO plus a week off in December
  • 100% coverage of health insurance for employees and 75% for dependents
  • 12 weeks of paid parental leave in the US
  • 401k with 3% matching, vested immediately
  • Work-from-home stipend for setup costs
  • Technology stipend for cell phone and internet expenses
  • Yearly Health & Wellness Allowance
  • Opportunity to collaborate on cutting-edge AI research
Full Job Description


About the Role

We are looking for a hands-on Data Engineer to help build and scale our modern data platform. In this role, you will work closely with Finance, Engineering, Product, and Analytics teams to develop reliable, high-performance data pipelines and systems.

You'll contribute to both batch and real-time data processing using technologies like Databricks, AWS, kafka and several 3rd party data, while helping ensure data quality, accessibility, and usability across the organization. You'll play a key role in enabling data activation, ensuring that high-quality data flows not only into the warehouse but also outward to business tools such as Salesforce etc. Additionally, you will help power next-generation AI-driven applications, including agent-based systems and AI driven tools using OSS tech, by building robust data foundations and pipelines. This is a great opportunity for someone who enjoys solving data challenges end-to-end from ingestion to insights.

Responsibilities
  • Build and maintain scalable data pipelines (batch and streaming) using tools such as Databricks, Spark, Kafka, and AWS services
  • Build and maintain pipelines from source systems (Salesforce, billing, product events, API logs) into clean analytics layers
  • Design, develop, and optimize ETL/ELT workflows using DBT, PySpark, SQL, and tools like Fivetran
  • Work closely with finance in developing Finance data solutions, Finance metrics and forecasting models
  • Partner with Finance on revenue accounting, COGS, and margin reporting
  • Partner closely with marketing and growth teams to enable data use cases such as segmentation, campaign targeting, and lifecycle analytics
  • Develop and maintain reverse ETL pipelines to sync data from the warehouse to tools like Salesforce, HubSpot, Braze, and other downstream systems
  • Create and manage curated datasets to support analytics, reporting, and go-to-market initiatives
  • Build and maintain dashboards and reporting layers to support marketing and business performance tracking
  • Support AI/ML and agent-based applications by preparing and serving high-quality datasets for MCP (Model Context Protocol) integrations and AI driven applications
  • Monitor pipeline performance, troubleshoot issues, and ensure high data reliability and quality
  • Implement data quality checks, validations, and alerting mechanisms across both ingestion and activation layers
  • Collaborate with cross-functional teams to define data contracts and ensure consistency across systems
Qualifications
  • 6+ years of experience in data engineering or a related field
  • Strong hands-on experience with Databricks, AWS (S3, Glue, Athena, EMR, etc.), and Kafka
  • Proficiency in Python (PySpark) and SQL for large-scale data processing
  • Experience building and maintaining ETL/ELT pipelines (DBT/Airflow or similar experience preferred)
  • Experience with data ingestion tools such as Fivetran (or similar)
  • Familiarity with reverse ETL / data activation workflows and syncing data to tools like Salesforce, HubSpot, Braze
  • Exposure to or experience with AI/ML data pipelines, including RAG architectures, vector databases, or embeddings workflows
  • Familiarity with agent-based systems, MCP integrations, or LLM-powered applications is a strong plus
  • Experience working with Finance and building finance specific metrics and pipelines is a strong plus
  • Understanding of data modeling and working with large-scale datasets (batch and streaming)
  • Experience creating dashboards and supporting reporting workflows (BI tools) for both internal and external audiences
  • Strong problem-solving skills and ability to debug production data issues
  • Strong communication skills and ability to work collaboratively across teams


Our salary bands are structured based on a combination of geographic tiers and internal leveling. Compensation is determined by multiple factors assessed during the interview process, with the final offer reflecting these considerations.

Salary Band

$180,000-$220,000 USD

Company Perks:
  • Hubs in San Francisco and New York City offering regular in-person gatherings and co-working sessions
  • Flexible PTO with U.S. holidays observed and a week shutdown in December to rest and recharge*
  • A competitive health insurance plan covers 100% of the policyholder and 75% for dependents*
  • 12 weeks of paid parental leave in the US*
  • 401k program, 3% match - vested immediately!*
  • $500 work-from-home stipend to be used up to a year of your start date*
  • $600 technology stipend to support a portion of our hybrid/remote team's cell phone and internet expenses*
  • $1,200 per year Health & Wellness Allowance to support your personal goals*
  • The chance to collaborate with a team at the forefront of AI research

*Certain perks and benefits are limited to full-time employees only

Similar Jobs

More Jobs at YOU.com

More Enterprise Technology Jobs

Find similar Data Engineer jobs: