Caterpillar, Inc

Autonomy Engineering Specialist - Perception

Caterpillar, Inc • $128K — $208K *
Manufacturing & Automotive
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7+ years of experience in perception and calibration for autonomous vehicles or robotics.
  • Strong background in computer vision, machine learning, and sensor fusion with practical application.
  • Proficient in C++ and Python with experience in developing production-quality software.
  • Demonstrated leadership skills in guiding development teams.
  • Familiarity with ROS/AIS, OpenCV, TensorFlow, and modern software tools.

Responsibilities

  • Solve complex perception challenges for mobile off-road machines.
  • Lead design and development of high-quality perception software.
  • Document architecture specifications, design, verification plans, and procedures.
  • Collaborate with application teams to analyze customer data and feedback.
  • Utilize tools to debug, test, and validate perception software.

Benefits

  • Medical, dental, and vision benefits.
  • Paid time off plan including vacations and holidays.
  • 401(k) savings plans with employer contributions.
  • Health Savings Account (HSA) and Flexible Spending Accounts (FSAs).
  • Career development and tuition reimbursement opportunities.
  • Employee assistance program and voluntary benefits.
Full Job Description

Career Area:

Technology, Digital and Data

Job Description:

As the Autonomy Engineering Specialist - Perception, you will be responsible for developing cutting-edge autonomous and operator-assisted driving systems. You will design, implement, and test modules for sensor fusion, object detection, tracking and classification and be a technical leader on the Perception team. You will also collaborate with other tech leads to integrate your solutions into our software stack and hardware platform.

What You Will Do:


  • Solve challenging perception problems for mobile off-road machines.
  • Lead other developers in the design and development of high-quality perception software to solve our customer needs.
  • Document architecture specifications, software design, verification plans, test cases, operating procedures, and safety procedures.
  • Work with application teams to collect and analyze data on customer experience with robotic and manned platforms. Participate in the iterative ML training cycles to meet perception requirements.
  • Use appropriate tools to debug, test and maintain perception software and assist in the verification and validation process.

What You Will Have:


Problem Solving:

  • Experience with modular perception ML and sensor fusion for autonomous vehicles and robotics. Familiarity with off-road autonomy applications is a plus.
  • Hands-on experience working with camera images, lidar and 4D radar point clouds, IMU, GNSS, and machine state data in real perception systems.
  • Solid understanding of object detection, drivable area understanding, ground plane segmentation, object tracking and fusion, and 3D mapping.

Software Development Life Cycle:

  • Participate in Agile software development from requirements and architecture through validation and deployment.
  • Develop software design documentation, verification plans, and test procedures.
  • Collaborate with engineering teams to deliver safe, production-quality autonomy solutions

Programming:

  • Excellence in C++
  • Fluency in Python
  • Experience developing computer vision, machine learning, sensor fusion, object detection, and tracking modules.
  • Strong software engineering, debugging, and code quality practices

Technical Troubleshooting:

  • Knowledge of debugging and validation tools to analyze and resolve perception software issues.
  • Ability to analyze code, logs, sensor data, and machine performance data to troubleshoot complex problems.
  • Experience with verification and validation activities for autonomous machine systems.

Considerations For Top Candidates:

  • Experience developing perception and calibration for autonomous vehicles, robotics, or advanced operator assist systems using lidar, radar, and cameras (typically 7+ years)
  • Strong background in computer vision, machine learning, deep learning, sensor fusion, object detection, classification, and tracking.
  • Demonstrated ability to lead other developers
  • Experience developing production-quality software in C++ and Python.
  • Experience with ROS/AIS, OpenCV, TensorFlow, PyTorch, and modern software development tools including Git, CMake, Docker, and GoogleTest.
  • Experience developing, integrating, or validating complex autonomous systems with a focus on machine safety and productivity.
  • Experience working in Agile environments using Azure DevOps or Jira and leveraging AWS cloud technologies (EC2, S3, Batch) for data processing and model development.

Additional Information:


  • This position requires the candidate towork full-time at the Irving, TX office.
  • Domestic relocation assistance is available for this position.
  • Visa sponsorship is NOT available with this position.
  • This position will require up to 10% travel

Summary Pay Range:

$128,470.00 - $208,770.00

Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location,job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.

Benefits:

Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.

  • Medical, dental, and vision benefits*

  • Paid time off plan (Vacation, Holidays, Volunteer, etc.)*

  • 401(k) savings plans*

  • Health Savings Account (HSA)*

  • Flexible Spending Accounts (FSAs)*

  • Health Lifestyle Programs*

  • Employee Assistance Program*

  • Voluntary Benefits and Employee Discounts*

  • Career Development*

  • Incentive bonus*

  • Disability benefits

  • Life Insurance

  • Parental leave

  • Adoption benefits

  • Tuition Reimbursement

* These benefits also apply to part-time employees

Posting Dates:

Any offer of employment is conditioned upon the successful completion of a drug screen.

Not ready to apply? Join our Talent Community.

About Caterpillar, Inc

Progress Rail Services Corporation, a Caterpillar company, is one of the largest integrated and diversified suppliers of railroad and transit system products and services worldwide. Since its acquisition by Caterpillar Inc. in 2006, Progress Rail has used the Caterpillar international footprint to gain quick and widespread notice and approval across the globe. Product technology, reliability and durability, along with legendary aftermarket parts and service support, have been their keys to success. Caterpillar is the world's leading manufacturer of construction and mining equipment, diesel and natural gas engines and industrial gas turbines. The technology and world reach of Caterpillar, combined with the service standard and historical reliability of Progress Rail, ensures their products and services make a growing impact on the world rail industry. With their acquisition of Electro-Motive Diesel (EMD), Progress Rail is the world's largest builder of diesel-electric locomotives for all commercial railroad applications including freight, intercity passenger, commuter, switching, industrial and mining. EMD is also a global provider of diesel power engines for marine propulsion, offshore and land based oil well drilling rigs and stationary power generation. Electro-Motive is the only diesel engine manufacturer of its size to have produced more than 70,000 engines. This success stems from product reliability, serviceability, load acceptance capability, low operating costs and ease of maintenance with standardized components.

Caterpillar, Inc. Careers

Join the robust team at Caterpillar, Inc., a global leader in construction and mining equipment, where innovation drives everything we do. As part of our team, you'll engage in work that improves the world and furthers your career with every project you touch.

Work You’ll Do

At Caterpillar, Inc., you will have the opportunity to contribute to a variety of groundbreaking projects that extend across the globe. Our commitment to leadership in the industry is unwavering, and we achieve it through a culture that fosters diversity and leadership development.

Explore Job Opportunities and Growth

Caterpillar offers a wide range of job opportunities and career paths, providing a platform for professional growth and development. Whether you're interested in engineering, sales, marketing, or management, Caterpillar has a position that will utilize your unique skills and talents. We are continuously hiring innovative minds to propel our mission forward and maintain our status as industry leaders.

Internship Programs

Kickstart your career with a Caterpillar internship. Our internships provide invaluable workplace experience and networking opportunities that often lead to full-time employment at our company. As an intern, you will work alongside experienced professionals and gain insights that will benefit you as you advance in your career.

Benefits and Culture

Choosing a career at Caterpillar means more than just having a job. It means you're part of a team that values diversity and is committed to creating an inclusive environment. We offer competitive benefits to ensure the health and well-being of our employees and their families. These benefits include health insurance, retirement plans, and paid time off, alongside unique perks like professional development and diversity training programs.

Innovation and Leadership

Drive innovation and industry leadership as part of the Caterpillar team. We empower our employees to lead from their first day on the job, encouraging continuous improvement and career advancement. At Caterpillar, your ideas will shape the future of our business and the industries we serve.

Join Our Team

Search open positions that match your skills and interests. We are looking for passionate, curious, and solution-driven team players. Ready to start your journey at Caterpillar, Inc.? Explore our career portal for the latest job opportunities.

Stay Connected

Keep up to date with company news, career tips, and industry insights—all from the people who work here. Subscribe to our careers blog and personalize your subscription to receive updates that align with your career interests.

Prepare for Your Interview

Make a great first impression. Prepare for your interview at Caterpillar by reviewing common questions and practicing your responses. Tailor your resume to highlight the experiences and skills that make you the ideal candidate for the position you are applying for. At Caterpillar, Inc., every role offers the chance to make an impact. Come be a part of our team and drive the future of our global industries. Your career at Caterpillar is not just about what you'll accomplish, but how you'll grow and the innovation you'll lead. Join us and build a career that matters.
Learn more about Caterpillar, Inc
Size
107,700 employees
Market Cap
$125.3 billion
Industry
Net Income
$2.9 billion
Founded
1925
5 Year Trend
+5.8%
Revenue
$41.7 billion
NASDAQ

Similar Jobs

More Jobs at Caterpillar, Inc

More Manufacturing & Automotive Jobs

Find similar Autonomy Engineering Specialist - Perception jobs: