Career Area:Engineering
Job Description:Job Summary:The Data Pipeline Engineer is responsible for developing, maintaining, and improving the data infrastructure that enables autonomy, robotics, and machine learning development across multiple programs. This role designs and supports scalable solutions for data ingestion, storage, discovery, processing, and annotation, ensuring that high-quality robotics data is accessible and usable throughout its lifecycle. The engineer collaborates closely with software, autonomy, AI/ML, and platform teams to build reliable data workflows, manage cloud-based storage and compute environments, and develop tools that accelerate data-driven development. Key responsibilities include supporting log processing systems, improving data integrity and discoverability, enabling large-scale compute workloads, automating data management processes, and contributing to platforms that support model training, validation, simulation, and analytics. Success in this role requires strong software engineering skills, experience with cloud infrastructure and data systems, a commitment to operational excellence, and the ability to work effectively within cross-functional teams to deliver scalable and maintainable solutions.
The Data Pipeline team's mission is to provide robust data infrastructure, compute resources, data management capabilities, annotation workflows, and development tools that accelerate autonomy and robotics development.
What You Will Do:- Design, develop, and maintain scalable data infrastructure that supports autonomy, robotics, and machine learning development across multiple programs.
- Build and enhance solutions for data ingestion, storage, discovery, processing, and annotation to ensure high-quality robotics data is accessible throughout its lifecycle.
- Develop and support reliable data workflows, cloud-based storage environments, and compute platforms that enable efficient data-driven development.
- Improve log processing systems, data integrity, discoverability, and automation capabilities to streamline data management at scale.
- Enable large-scale compute workloads and contribute to platforms that support model training, validation, simulation, analytics, and autonomous system development.
- Partner closely with software, autonomy, AI/ML, and platform teams to deliver robust data infrastructure, annotation workflows, development tools, and compute resources that accelerate autonomy and robotics innovation.
What You Will Have:- Problem Solving: Knowledge of approaches, tools, techniques for recognizing, anticipating, and resolving organizational, operational or process problems; ability to apply knowledge of problem solving appropriately to diverse situations.
- Programming: Knowledge of relevant programming languages and tools; ability to test, write, design, debug, troubleshoot and maintain source codes and computer programs.
- Technical Troubleshooting: Knowledge of technical troubleshooting approaches, tools and techniques; ability to anticipate, recognize, and resolve technical issues on hardware, software, application or operation.
Considerations For Top Candidates:- Bachelor's or master's degree in computer engineering, Computer Science, Software Engineering, Robotics, Data Engineering, or a related field.
- Experience developing software in Python, C++, or similar programming languages.
- Experience with cloud platforms, data storage, and distributed computing environments.
- Understanding of data pipelines, ETL processes, data lifecycle management, and automation.
- Familiarity with machine learning workflows, robotics data, or autonomous systems is preferred.
Additional Information:- This position requires the candidate to work full-time at the Irving, TX office.
- Domestic relocation assistance is available for this position.
- Visa sponsorship is NOT available with this position.
- This position will require up to 10% travel
- #LI
Summary Pay Range:$112,710.00 - $183,140.00
Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.
Benefits:Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.
- Medical, dental, and vision benefits*
- Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
- 401(k) savings plans*
- Health Savings Account (HSA)*
- Flexible Spending Accounts (FSAs)*
- Health Lifestyle Programs*
- Employee Assistance Program*
- Voluntary Benefits and Employee Discounts*
- Career Development*
- Incentive bonus*
- Disability benefits
- Life Insurance
- Parental leave
- Adoption benefits
- Tuition Reimbursement
* These benefits also apply to part-time employees
Posting Dates:Any offer of employment is conditioned upon the successful completion of a drug screen.
Not ready to apply? Join our Talent Community.
