Data Engineer

Mill

$185K — $210K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5 years of experience in production data engineering systems
  • Proficient in building and operating data pipelines using Python and tools like dbt, Airflow, or Fivetran
  • Strong SQL skills with experience in cloud data warehouses such as Snowflake, BigQuery, or Redshift
  • Experience with recommendation systems incorporating multiple data sources, including LLMs
  • Background in CI/CD for data pipelines, with a focus on testing and measuring outcomes
  • A bias towards clarity and action
  • Ability to work collaboratively with data consumers as partners.

Responsibilities

  • Design and maintain scalable data pipelines across product and operational systems
  • Build and manage customer-facing recommendation engine utilizing food waste data
  • Design transformation and integration pipelines for diverse food data sources
  • Collaborate with analytics and marketing teams to support self-service analytics
  • Maintain data quality monitoring including alerting and validation frameworks
  • Implement CI/CD best practices for data pipelines, including testing and rollback strategies
  • Define and maintain metrics and business logic for company-wide consistency.

Benefits

  • Collaborative and dynamic work environment
  • Opportunities to interact with cross-functional teams
  • Focus on innovative projects involving the latest data technologies
  • Hands-on involvement with cloud-based and scalable data solutions
  • Potential to work with cutting-edge recommendation systems involving LLMs.
Full Job Description

The Role

As a Data Engineer at Mill, you'll touch systems end-to-end - from raw ingestion to the recommendation a customer sees in the app to managing the data warehouse. You'll architect a warehouse model one week and tune recommendation logic the next. You'll partner closely with product, engineering, data analytics, and marketing teams.
What You'll Do
  • Design, build, and maintain scalable data pipelines across Mill's product and operational systems
  • Build and operate the customer-facing recommendation engine - including LLM-based logic where useful - that turns characterized food waste data into actionable recommendations: purchasing suggestions, anomaly explanations, operational nudges
  • Design transformation and integration pipelines for food data coming from multiple sources - including agent-based reconciliation where it helps - handling schema changes, validation, and consistency issues
  • Partner with data analytics and marketing teams to support self-serve analytics tools
  • Own data quality monitoring - build alerting, validation frameworks, and observability tooling
  • Bring CI/CD discipline to pipeline - automated tests, staged rollouts, and rollback paths - and track recommendation accuracy over time so we know whether a change actually helped
  • Define and maintain the metrics, table endorsements, and business logic that analysts and stakeholders rely on - so everyone across the company is working from the same numbers
What We're Looking For
  • 5 years of experience operating data engineering systems in production
  • Have built and operated data pipelines in production using Python and tools like dbt, Airflow, Fivetran, or similar - including handling failures, backfills, and schema changes after launch
  • Strong SQL skills and experience with a cloud data warehouse (e.g., Snowflake, BigQuery, Redshift)
  • Experience with recommendation systems or pipelines that combine multiple data sources into a single product-facing output, in production - including recommendation logic built with LLMs
  • Have set up CI/CD for data pipelines or product logic (automated testing, staged rollout, rollback), and have measured whether a change to a recommendation or model actually improved outcomes, not just shipped it
  • A bias toward clarity and action
  • Comfort working in a collaborative environment where data consumers are partners, not just stakeholders
Nice to Have
  • Exposure to distributed systems concepts (partitioning, consistency, fault tolerance)
  • Hands-on experience with infrastructure as code (Terraform, Pulumi) in a cloud environment
  • Experience with Hex, Mixpanel, Tableau, or similar BI/analytics tools
  • Familiarity with data contract or data mesh patterns
  • Experience with event tracking or product analytics

The estimated base salary range for this position is $185k to $210k, which does not include the value of benefits or a potential equity grant. A wide range of factors are considered in making compensation decisions, including but not limited to skill sets, market conditions, experience and training, licensure and certifications, and business and organizational needs.

Similar Jobs

More Jobs at Mill

More Information Technology Jobs

Find similar Data Engineer jobs: