Data Infrastructure Engineer

Alljoined

$140K — $180K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 3+ years of production software engineering experience with expertise in systems-level architecture.
  • Proficient in languages such as Python, Rust, C++, or Go.
  • Experienced in building and maintaining high-performance ETL pipelines for terabytes of unstructured data.
  • Skilled in architecting and maintaining bare-metal compute clusters and high-speed storage.
  • Capable of managing data streams from diverse hardware peripherals without loss.
  • Familiar with hybrid environments and managing databases like TimescaleDB and ClickHouse.

Responsibilities

  • Build backend and hardware architecture for fast, high-quality research.
  • Own the entire data lifecycle, from processing to storage of multimodal datasets.
  • Provision and manage cloud and bare metal compute clusters for model training.
  • Bridge the gap between neuro hardware and data repositories for efficient workflows.
  • Collaborate with researchers to ensure optimized data pipelines for GPU utilization.

Benefits

  • Competitive equity compensation at a seed stage startup.
  • Options for housing support.
  • Visa sponsorship available.
  • 3% 401k matching to support retirement planning.
  • Health insurance for employee well-being.
Full Job Description
About the Role

As a Data Infrastructure Engineer, you will build the backend and hardware architecture that allows us to do high-quality and fast research. You'll be owning our entire data lifecycle, from building pipelines that process massive multimodal datasets (video, audio, text, time-series) to provisioning and managing both cloud and bare metal compute clusters we use to train on it. You will be powering our foundational model training by bridging the gap between physical neuro hardware and our central repositories, working alongside world-class researchers to ensure they have a high-throughput, low-latency pipeline straight to the GPUs.

You might be a good fit if you
  • Have 3+ years of production software engineering experience with deep expertise in systems-level architecture and languages like Python, Rust, C++, or Go.
  • Have built and maintained high-performance ETL pipelines capable of processing, buffering, and storing terabytes of daily unstructured data.
  • Are comfortable architecting, provisioning, and maintaining bare-metal local compute clusters, storage servers, and high-speed networking for intensive ML workloads.
  • Have a background in handling continuous, highly concurrent data streams from heterogeneous hardware peripherals without data loss.
  • Are capable of working across hybrid environments to define storage topologies, manage databases (TimescaleDB, ClickHouse), and sync massive datasets between on-premise edge servers and the cloud (AWS/GCP/Azure).
  • Enjoy owning the entire technical lifecycle of infrastructure, from optimizing low-level I/O bound operations to production deployment.


Strong candidates may have
  • A deep understanding of modern ML frameworks (PyTorch/TensorFlow) and know how to build datasets that maximize and saturate GPU utilization.
  • Experience managing networking for distributed GPU training (InfiniBand, RoCE) or optimizing zero-copy networking and shared memory.
  • Built infrastructure involving programmatic video processing (FFmpeg, GStreamer, OpenCV)


Compensation Range

$140,000 - $180,000/year

While this represents our expected range based on market data, final compensation will be determined based on your specific skills and experience and may be outside this range.

Benefits
  • Competitive equity compensation at a seed stage startup
  • Options for housing support
  • Visa sponsorship
  • 3% 401k matching
  • Health insurance

Similar Jobs

More Jobs at Alljoined

More Information Technology Jobs

Find similar Data Infrastructure Engineer jobs: