Senior Data Engineer - Data Lead

Foundry Robotics Inc

$150K — $250K *
Manufacturing & Automotive
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of data engineering experience at terabyte to petabyte scale
  • Hands-on experience with pipeline frameworks like Spark, Flink, Kafka
  • Strong proficiency in Python and SQL; backend languages like Go, Java, or TypeScript is a plus
  • Experience designing data architectures with streaming, batch, lakehouse patterns
  • Solid understanding of distributed systems and data modeling
  • Experience with cloud data services (AWS, GCP, Azure)
  • Comfortable in defining roadmaps and making architectural decisions

Responsibilities

  • Design and operate petabyte-scale data pipelines for manufacturing data
  • Implement reliable data movement across various environments
  • Build high-throughput streaming and batch processing systems
  • Manage data lifecycle including retention and archival
  • Define and govern the data roadmap and architecture
  • Create data models and schemas for applications and analytics
  • Contribute to backend services where data meets application logic

Benefits

  • Comprehensive health, dental and vision coverage
  • Generous paid time off (PTO)
  • Equity compensation opportunities
  • Access to advanced data technologies and tools
  • Professional growth into data leadership roles
Full Job Description
The Role

We are hiring a Sr Data Engineer / Data Lead to own the data layer that powers Factory OS. You will design and operate petabyte-scale data pipelines that ingest visual, telemetry, and manufacturing data from the factory floor, move it reliably across edge, on-prem, and cloud environments, and make it available for ML training, analytics, and operational decision-making. You will define the data roadmap-architecture, governance, lifecycle, and tooling-and be the person the rest of the engineering org depends on for clean, reliable, well-modeled data. You will also contribute to backend services where data meets application logic. This is a hands-on engineering role. You will ship.

Key Responsibilities

Petabyte-Scale Data Pipelines
  • Design, build, and operate PB-scale data pipelines for ingesting, curating, indexing, and preparing manufacturing, visual, and telemetry data
  • Implement reliable data movement across embedded, edge, on-prem, and cloud compute environments
  • Build streaming and batch processing systems that handle high-throughput factory-floor data in real time
  • Implement data lifecycle management: retention, archival, compaction, and cost optimization at scale

Data Architecture + Roadmap
  • Define and own the Factory OS data roadmap-architecture, governance, quality, and tooling strategy
  • Design data models, schemas, and contracts that serve application, ML, and analytics consumers
  • Establish data cataloging, lineage tracking, and discoverability across the platform
  • Drive data quality standards: validation, monitoring, alerting, and anomaly detection
  • Evaluate and adopt data technologies (warehouses, lakehouses, streaming platforms) as the platform scales

Backend Services + Integration
  • Contribute to backend services where data pipelines meet application logic (APIs, event-driven systems, database layers)
  • Partner with ML engineers to ensure training and inference pipelines have access to clean, well-prepared datasets
  • Collaborate with full-stack developers, robotics teams, and operations to translate data needs into reliable infrastructure
  • Implement observability: metrics, logging, and tracing across data systems
What We're Looking For
  • Between 5-7 years of experience in data engineering, with demonstrated work at terabyte-to-petabyte scale
  • Deep hands-on experience with data pipeline frameworks (Spark, Flink, Kafka, Airflow, dbt, or similar)
  • Strong proficiency in Python and SQL; backend experience in Go, Java, or TypeScript is a plus
  • Experience designing data architectures spanning streaming, batch, lakehouse, and warehouse patterns
  • Solid understanding of distributed systems, storage engines, and data modeling (relational and NoSQL)
  • Experience with cloud data services (AWS S3/Glue/Redshift, GCP BigQuery/Dataflow, or Azure equivalents)
  • Comfortable defining roadmaps, making architectural decisions, and driving alignment across teams
  • Comfortable operating independently and owning complex systems end-to-end
Nice to Have (Not Required)
  • Experience with visual or image data pipelines at scale (video ingestion, frame extraction, annotation workflows)
  • Background in manufacturing, robotics, or industrial IoT data systems
  • Familiarity with ML data preparation workflows (feature stores, dataset versioning, labeling pipelines)
  • Experience with edge-to-cloud data architectures and intermittent connectivity patterns
  • Exposure to infrastructure-as-code (Terraform, Pulumi) and container orchestration (Kubernetes)
Growth Opportunities
  • Define the entire data architecture and roadmap for an AI-native factory
  • Work with petabyte-scale visual, telemetry, and manufacturing data in a real production environment
  • Grow into a data leadership role as the team and platform scale
  • Direct influence on how data drives quality, throughput, and cost improvements in physical manufacturing

The base salary range for this full-time position in the location of San Francisco is:

$150,000-$250,000 USD

Compensation packages at Foundry Robotics for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position, determined by work location and additional factors, including job-related skills, experience, interview performance, and relevant education or training. Foundry Robotics employees in eligible roles are also granted equity based compensation, subject to Board of Director approval. You'll also receive benefits including, but not limited to: Comprehensive health, dental and vision coverage, and generous PTO.

Similar Jobs

More Jobs at Foundry Robotics Inc

  • Head of Supply Chain
    $150K — $250K *
    San Francisco, CA 94112 (San Francisco County)
    Manufacturing & Automotive
    In-Person
  • Logistics & Inventory Manager
    $150K — $250K *
    San Francisco, CA 94112 (San Francisco County)
    Manufacturing & Automotive
    In-Person
  • Senior Quality Engineer
    $150K — $250K *
    San Francisco, CA 94112 (San Francisco County)
    Aerospace & Defense
    In-Person
  • Deployment Strategist
    $150K — $250K *
    San Francisco, CA 94112 (San Francisco County)
    Aerospace & Defense
    In-Person
  • Operations Manager, Robotics Data
    $150K — $250K *
    San Francisco, CA 94112 (San Francisco County)
    Technical Services
    In-Person

More Manufacturing & Automotive Jobs

Find similar Senior Data Engineer - Data Lead jobs: