Meet the TeamTorc's Data Engineering team is a highly collaborative group focused on building secure, scalable systems that let customers work with data easily and confidently. We operate as a distributed, remote first team, ensuring everyone has equal access to information and collaboration. Our work includes frequent touchpoints-daily standups, planning sessions, and ad hoc discussions over Zoom or Slack. Because we own our services end-to-end, each engineer participates in a business hour on call rotation. We prioritize healthy work/life balance and sustainable development over heroic efforts.
What You'll DoWe are seeking a Software Engineer with experience in implementing and maintaining Linux and cloud-based data management solutions who is ready to extend that experience. In this role you will be working closely with other engineers on the implementation of AWS-native data ingestion, ETL, and storage solutions that power data driven analytics, simulation, and ML training across the enterprise.
- Create robust and resilient pipelines to process massive daily volumes of data created by vehicle fleets and simulation environments
- Build and support scalable pipelines as part of Torc's Data Factory to delivery data for ML training at scale
- Scale Torc's data lake through a distributed storage system, data crawling and discovery
- Promote and protect the integrity of data through validation, versioning, data provenance, and governance
- Support the expansion of Torc's data lake through acquisition of additional data sets from internal and external sources
- Contribute to the design, architecture and delivery of cloud-based solutions
- Collaborate with teams specializing in perception, planning, control, mapping and vehicle testing to develop solutions that support product delivery
- Support the implementation of emerging cloud-based capabilities that can extend our technology stack and improve our ability to build, deploy and test safety-critical software for self-driving vehicles
- Participate in the team's on-call rotation to support our deployed systems during business hours
Here's a list of some of the technologies we use to make all the above happen:
- Managed services powered by AWS (Lambda, SFN, Batch, EventBridge, Athena, Glue)
- Linux / Bash
- Docker
- Terraform
- Python
- React/Javascript
- On-Call Tooling (Datadog, AWS Cloudwatch)
- CI/CD Tooling (Jenkins, GitHub Actions)
What You'll Need to Succeed- Bachelor's Degree in Computer Science, Robotics, Electrical Engineering or related technical field plus demonstrates competences and technical proficiencies typically acquired through 4+ years of experience or;
- Master's Degree in Computer Science, Robotics, Electrical Engineering or related technical field plus demonstrates competences and technical proficiencies typically acquired through 0-3+ years of experience.
- Experience deploying, troubleshooting, monitoring and maintaining Linux systems
- Experience building and maintaining workloads in public cloud environments
- Knowledge of different database architectures, including but not limited to relational and NoSQL databases, vector stores, data warehousing and clustered, distributed data stores
- Practical experience with Linux and general bash scripting
- Practical experience with Docker and containerization
- Implementation of workflow patterns using directed acyclic graphs (Apache Airflow, AWS Step Functions)
- A strong commitment to test-driven development patterns, continuous integration and delivery, and infrastructure as code
Bonus Points- Strong organizational, time management, and communication skills working with a team orientation and collaborative style
- Experience with the Databricks platform, particularly for serving data, visualizations and jobs
- Experience with scaling data for ML and AI workloads using Ray
- Experience with pandas, numpy and other Python-based data analysis libraries and tooling
- Deep knowledge of AWS serverless architectures (Lambda, Batch, ECS Fargate, Glue, Athena)
- Experience with data storage and acquisition patterns for robotics and advanced driver assistance systems
- Own end-to-end architecture and delivery of cloud-based solutions.
Perks of Being a Full-time Torc'r Torc cares about our team members and we strive to provide benefits and resources to support their health, work/life balance, and future. Our culture is collaborative, energetic, and team focused. Torc offers:
- A competitive compensation package that includes a bonus component and stock options
- 100% paid medical, dental, and vision premiums for full-time employees
- 401K plan with a 6% employer match
- Flexibility in schedule and generous paid vacation (available immediately after start date)
Job ID: 102860
Hiring Range for Job Opening US Pay Range
$139,000-$166,800 USD
