Caterpillar, Inc

Principal Perception Architect - Detection and Fusion

Caterpillar, Inc$147K — $240K *
Transportation
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in modular perception ML and sensor fusion for autonomous vehicles or robotics.
  • Hands-on experience with sensor data processing: camera, lidar, 4D radar, IMU, GNSS, and machine state data.
  • In-depth knowledge of object detection, drivable area understanding, and ground plane segmentation.
  • Demonstrated ability to manage object tracking and fusion in real-world applications.
  • Experience collaborating with cross-functional teams including edge platform, robotics, and simulation.

Responsibilities

  • Define architecture for modular perception ML focused on object detection and space understanding.
  • Develop sensor fusion architecture to enhance perception consistency and environmental awareness.
  • Establish object tracking processes and management strategies for persistent representation.
  • Design 3D mapping frameworks for local-to-global map integration.
  • Create interfaces for perception outputs to be used across various technologies in robotics and simulation.

Benefits

  • Medical, dental, and vision coverage.
  • Paid time off including vacation, holidays, and volunteer days.
  • 401(k) retirement savings plans.
  • Health Savings Account (HSA) options.
  • Flexible Spending Accounts (FSAs) for additional savings.
  • Wellness programs promoting health lifestyle choices.
  • Employee Assistance Program for personal support.
  • Career development opportunities for professional growth.
  • Incentive bonuses based on performance.
  • Disability and life insurance benefits.
  • Parental leave and adoption support.
  • Tuition Reimbursement for continued learning.
Full Job Description

Career Area:

Technology, Digital and Data

Job Description:

Job Summary

Own the architecture for modular perception machine learning, sensor fusion, object tracking, object persistence, and 3D mapping using perception sensor data such as camera images, lidar point clouds, 4D radar point clouds, IMU data, GNSS data, and machine state inputs.

This role focuses on transforming synchronized sensor data into reliable perception outputs, including detected objects, tracked objects, persistent object representation cross machines, drivable area segmentation, and local-to-global 3D maps. These outputs must be structured for use by robotics, simulation, and safety analysis.

Primary Responsibilities

  • Define the modular perception ML architecture for camera-based object detection and drivable area understanding, point-cloud-based ground plane segmentation and object detection, and 4D radar-aided perception.

  • Own the sensor fusion architecture across camera, lidar, 4D radar, IMU, GNSS, and machine state data to improve perception robustness, spatial consistency, and environmental awareness.

  • Define object tracking and object persistence architecture, including object association, object lifecycle management, occlusion handling, and persistent object representation across multiple machines operating in the field.

  • Own 3D mapping architecture, including local 3D scene representation, local-to-global map alignment, and support for persistent world representation.

  • Define perception output interfaces for downstream consumers, including robotics, simulation, world model creation, validation, and safety analysis.

Candidate Requirements

  • Strong experience with modular perception ML and sensor fusion for autonomous vehicles and robotics. Familiarity with construction, or off-road autonomy applications is a plus.

  • Hands-on experience working with camera images, lidar and 4D radar point clouds, IMU, GNSS, and machine state data in real perception systems.

  • Solid understanding of object detection, drivable area understanding, ground plane segmentation, object tracking and fusion, and 3D mapping.

  • Ability to work cross-functionally with edge platform, robotics and simulation teams to turn perception algorithms into usable autonomy capabilities.

Additional Details:

·         This position requires the candidate to work full-time at the Irving, TX office (Dallas)

·         Domestic relocation assistance is available for this position.

·         Visa sponsorship is available for this position

·         This position will require up to 25% domestic travel


 

Summary Pay Range:

$147,760.00 - $240,110.00

Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar. 

Benefits:

Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.

  • Medical, dental, and vision benefits*

  • Paid time off plan (Vacation, Holidays, Volunteer, etc.)*

  • 401(k) savings plans*

  • Health Savings Account (HSA)*

  • Flexible Spending Accounts (FSAs)*

  • Health Lifestyle Programs*

  • Employee Assistance Program*

  • Voluntary Benefits and Employee Discounts*

  • Career Development*

  • Incentive bonus*

  • Disability benefits

  • Life Insurance

  • Parental leave

  • Adoption benefits

  • Tuition Reimbursement

       

* These benefits also apply to part-time employees

 

 

This position requires working onsite five days a week. 

 

Relocation is available for this position.

 

 

Visa sponsorship is available for eligible applicants.

 

 

Posting Dates:

About Caterpillar, Inc

Progress Rail Services Corporation, a Caterpillar company, is one of the largest integrated and diversified suppliers of railroad and transit system products and services worldwide. Since its acquisition by Caterpillar Inc. in 2006, Progress Rail has used the Caterpillar international footprint to gain quick and widespread notice and approval across the globe. Product technology, reliability and durability, along with legendary aftermarket parts and service support, have been their keys to success. Caterpillar is the world's leading manufacturer of construction and mining equipment, diesel and natural gas engines and industrial gas turbines. The technology and world reach of Caterpillar, combined with the service standard and historical reliability of Progress Rail, ensures their products and services make a growing impact on the world rail industry. With their acquisition of Electro-Motive Diesel (EMD), Progress Rail is the world's largest builder of diesel-electric locomotives for all commercial railroad applications including freight, intercity passenger, commuter, switching, industrial and mining. EMD is also a global provider of diesel power engines for marine propulsion, offshore and land based oil well drilling rigs and stationary power generation. Electro-Motive is the only diesel engine manufacturer of its size to have produced more than 70,000 engines. This success stems from product reliability, serviceability, load acceptance capability, low operating costs and ease of maintenance with standardized components.

Caterpillar, Inc. Careers

Join the robust team at Caterpillar, Inc., a global leader in construction and mining equipment, where innovation drives everything we do. As part of our team, you'll engage in work that improves the world and furthers your career with every project you touch.

Work You’ll Do

At Caterpillar, Inc., you will have the opportunity to contribute to a variety of groundbreaking projects that extend across the globe. Our commitment to leadership in the industry is unwavering, and we achieve it through a culture that fosters diversity and leadership development.

Explore Job Opportunities and Growth

Caterpillar offers a wide range of job opportunities and career paths, providing a platform for professional growth and development. Whether you're interested in engineering, sales, marketing, or management, Caterpillar has a position that will utilize your unique skills and talents. We are continuously hiring innovative minds to propel our mission forward and maintain our status as industry leaders.

Internship Programs

Kickstart your career with a Caterpillar internship. Our internships provide invaluable workplace experience and networking opportunities that often lead to full-time employment at our company. As an intern, you will work alongside experienced professionals and gain insights that will benefit you as you advance in your career.

Benefits and Culture

Choosing a career at Caterpillar means more than just having a job. It means you're part of a team that values diversity and is committed to creating an inclusive environment. We offer competitive benefits to ensure the health and well-being of our employees and their families. These benefits include health insurance, retirement plans, and paid time off, alongside unique perks like professional development and diversity training programs.

Innovation and Leadership

Drive innovation and industry leadership as part of the Caterpillar team. We empower our employees to lead from their first day on the job, encouraging continuous improvement and career advancement. At Caterpillar, your ideas will shape the future of our business and the industries we serve.

Join Our Team

Search open positions that match your skills and interests. We are looking for passionate, curious, and solution-driven team players. Ready to start your journey at Caterpillar, Inc.? Explore our career portal for the latest job opportunities.

Stay Connected

Keep up to date with company news, career tips, and industry insights—all from the people who work here. Subscribe to our careers blog and personalize your subscription to receive updates that align with your career interests.

Prepare for Your Interview

Make a great first impression. Prepare for your interview at Caterpillar by reviewing common questions and practicing your responses. Tailor your resume to highlight the experiences and skills that make you the ideal candidate for the position you are applying for. At Caterpillar, Inc., every role offers the chance to make an impact. Come be a part of our team and drive the future of our global industries. Your career at Caterpillar is not just about what you'll accomplish, but how you'll grow and the innovation you'll lead. Join us and build a career that matters.
Learn more about Caterpillar, Inc
Size
107,700 employees
Market Cap
$125.3 billion
Industry
Net Income
$2.9 billion
Founded
1925
5 Year Trend
+5.8%
Revenue
$41.7 billion
NASDAQ

Similar Jobs

More Jobs at Caterpillar, Inc

  • Caterpillar, Inc
    Lead Software Engineer
    $128K — $208K *
    Westminster, CO 80031 (Adams County)
    Information Technology
    In-Person
  • Caterpillar, Inc
    Senior UX/UI Designer-2
    $112K — $183K *
    Irving, TX 75061 (Dallas County)
    Consumer Technology
    In-Person
  • Caterpillar, Inc
    Electrical Design Engineer
    $97K — $146K *
    Mossville, IL 61552 (Peoria County)
    Manufacturing & Automotive
    In-Person
  • Caterpillar, Inc
    Tax Manager
    $128K — $192K *
    Irving, TX 75061 (Dallas County)
    Legal & Accounting
    In-Person
  • Caterpillar, Inc
    Senior Category Buyer
    $128K — $192K *
    Morton, IL 61550 (Tazewell County)
    Manufacturing & Automotive
    In-Person

More Transportation Jobs

Find similar Principal Perception Architect - Detection and Fusion jobs: