Career Area:
Technology, Digital and Data
Job Description:
We are seeking a Senior AI Automation Engineer to develop annotation automation solutions used to create training data for robotics, autonomy, computer vision, and Vision-Language-Action (VLA) systems with a scrum team.
This role combines software engineering, machine learning, and data engineering to build automated annotation and captioning capabilities for real-world heavy equipment and construction environments. You will help deploy and extend technologies such as NVIDIA Cosmos Curator and Cosmos Reason while also developing Caterpillar-specific AI models that enable automated labeling, automated captioning, and AI-driven quality assurance.
This is a hands-on technical role focused on turning complex AI and data challenges into scalable production solutions.
What You'll Do
Develop and deploy automated labeling and captioning solutions for perception and VLA datasets.
Train, fine-tune, and evaluate AI models to support auto-labeling, auto-captioning, and annotation quality automation.
Build data pipelines and workflows that move datasets through automated labeling, human review, quality validation, and dataset publication.
Implement and extend platforms such as NVIDIA Cosmos Curator, Cosmos Reason, and other emerging AI automation technologies.
Develop solutions that integrate Caterpillar data systems with external annotation providers and human-in-the-loop workflows.
Ensure reliability, scalability, observability, and operational excellence across annotation automation services.
What Makes This Role Unique
Most AI automation solutions are not trained to understand heavy equipment, jobsites, sensor data, or machine operations.
In this role, you'll help develop the AI capabilities needed to label and describe Caterpillar-specific data at scale. You'll work on challenges involving computer vision, multimodal AI, robotics, autonomy, and Vision-Language-Action systems while helping create the data foundation that powers the future of intelligent machines.
Basic Qualifications
Bachelor's degree in Computer Science, Software Engineering, Artificial Intelligence, Machine Learning, Robotics, or a related field.
Experience developing production-grade software solutions using Python, modern software engineering practices and containerization platforms (e.g. Docker, Kubernetes).
Experience designing and implementing distributed systems, APIs, and data processing pipelines.
Experience training, fine-tuning, or deploying machine learning models.
Strong problem-solving skills and ability to work across multiple technical disciplines.
2+ years of experience generating and managing camera and LiDAR sensor datasets for perception or machine learning applications, including data collection pipeline design and ground truth generation.
1+ years of experience in data annotation and quality assurance for autonomous systems or computer vision projects, with demonstrated ability to define annotation guidelines, identify labeling defects, and drive measurable improvements in dataset accuracy.
Experience using annotation and dataset management tools such as Labelbox, Supervisely, RoboFlow or similar toolchains.
Experience using machine learning frameworks and training tools such as PyTorch, TensorFlow, ONNX, Weights & Biases, MLflow or similar frameworks.
Preferred Qualifications
Experience with computer vision, robotics, autonomy, Physical AI, or multimodal AI systems.
Experience with AI-assisted annotation, auto-labeling, or machine learning data pipelines.
Experience training or fine-tuning foundation models, vision models, or multimodal models.
Experience with NVIDIA Cosmos Curator, Cosmos Reason, or similar AI automation platforms.
Experience with Vision-Language-Action (VLA) datasets and workflows.
Experience with sensor data such as cameras, LiDAR, radar, or autonomous machine datasets.
Experience with cloud platforms, MLOps, and machine learning deployment pipelines.
Experience building human-in-the-loop AI workflows and quality automation systems.
Additional Details:
This position requires the candidate to work full-time at the Irving, TX office (Dallas)
Domestic relocation assistance is available for this position.
Visa sponsorship is available with this position.
Summary Pay Range:
$112,710.00 - $183,140.00
Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.
Benefits:
Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.
Medical, dental, and vision benefits*
Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
401(k) savings plans*
Health Savings Account (HSA)*
Flexible Spending Accounts (FSAs)*
Health Lifestyle Programs*
Employee Assistance Program*
Voluntary Benefits and Employee Discounts*
Career Development*
Incentive bonus*
Disability benefits
Life Insurance
Parental leave
Adoption benefits
Tuition Reimbursement
* These benefits also apply to part-time employees
This position requires working onsite five days a week.
Relocation is available for this position.
Visa sponsorship is available for eligible applicants.
Posting Dates:
