General Motors

Senior Machine Learning Perception Engineer - Fallback Driving System

General Motors$170K — $261K *
Transportation
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • BS, MS, or PhD in Machine Learning, Robotics, Computer Science, or related field; or equivalent practical experience in ML perception systems.
  • 3-5 years of experience in ML solutions for perception, prediction, and/or autonomous driving.
  • Strong expertise in multi-modal sensor data handling, including preprocessing and fusion.
  • Deep knowledge of modern deep learning architectures for perception (e.g., CNNs, transformers) for detection and segmentation.
  • Proficiency in ML frameworks (e.g., PyTorch, TensorFlow, JAX) and Python for development.
  • Solid software engineering skills in C++ or similar languages within collaborative coding environments.
  • Proven ability to define ML metrics and conduct experiments to enhance model performance.

Responsibilities

  • Design, train, and evaluate ML perception models for object detection and tracking using multi-modal data.
  • Develop the secondary stack perception model for safe vehicle fallback autonomy when primary systems fail.
  • Define and drive ML success metrics and systematic experimentation to enhance model performance.
  • Curate datasets and develop strategies for improving model robustness under challenging conditions.
  • Implement training and inference pipelines, optimizing models to fit on-vehicle compute and latency needs.
  • Collaborate with software engineers to integrate models into production systems and ensure proper monitoring.
  • Contribute to validation strategies for fallback models, involving offline evaluation and on-road testing.

Benefits

  • Comprehensive health and wellbeing benefit programs, including medical, dental, and vision coverage.
  • Health Savings Account and Flexible Spending Accounts available for employee use.
  • Retirement savings plans and various life insurance options offered.
  • Paid vacation and holidays along with tuition assistance programs.
  • Employee assistance program and GM vehicle discounts accessible to employees.
  • Potential eligibility for relocation benefits.
Full Job Description
As a Senior Machine Learning Engineer on the State Estimation and Mapping (SEAM) organization, you will develop and improve the ML perception model that powers the secondary (fallback) autonomy stack for Super Cruise 3. You will focus on building robust perception from multi-modal camera, lidar, and radar data so the vehicle can safely bring itself to a stop when the primary autonomy stack is unavailable. You will lead the design, implementation, and continuous improvement of ML models for object detection, segmentation, tracking, and prediction, working closely with partner teams across perception, planning, controls, and safety. What You'll Do • Design, train, and evaluate ML perception models for object detection, semantic/instance segmentation, tracking, and short-horizon prediction using multi-modal camera, lidar, and radar data. • Develop and maintain the secondary stack perception model that enables the fallback autonomy system to safely bring the vehicle to a minimal risk condition when the primary system experiences a fault. • Define clear ML success metrics (e.g., precision/recall, latency, robustness under edge cases) and drive systematic experimentation to improve model performance against those metrics. • Analyze large-scale datasets, curate challenging scenarios, and build data selection and labeling strategies that improve robustness for long-tail and degraded-sensor conditions. • Implement efficient training and inference pipelines, including model optimization techniques (e.g., pruning, quantization, distillation) to meet on-vehicle compute and latency budgets. • Collaborate with software and infra engineers to integrate models into production systems, including interfaces, configuration, deployment, monitoring, and regression safeguards. • Partner with Safety, Systems Engineering, and Product to translate system requirements into concrete ML model requirements, metrics, and validation criteria. • Contribute to verification and validation strategies for the fallback perception model, including offline evaluation, simulation, hardware-in-the-loop, and on-road testing. • Participate in code reviews, promote ML and software engineering best practices, and provide technical mentorship to other engineers. Qualifications • BS, MS, or PhD in Machine Learning, Robotics, Computer Science, or a related technical field; or equivalent practical experience building ML perception systems. • 3-5 years of experience developing ML solutions in perception, prediction, and/or autonomous driving or related domains. • Strong experience with multi-modal sensor data (camera, lidar, radar), including data preprocessing, synchronization, and fusion. • Deep expertise in modern deep learning for perception, such as convolutional and transformer-based architectures for: • 2D/3D object detection • Semantic and instance segmentation • Multi-object tracking and motion prediction • Proficiency in at least one major ML framework (e.g., PyTorch, TensorFlow, JAX) and Python for model development, training, and analysis. • Solid software engineering skills, including experience working in C++ or similar languages in large, collaborative codebases. • Demonstrated ability to define ML metrics, design experiments, and systematically improve model performance and robustness. • Strong problem-solving, communication, and cross-functional collaboration skills. • Self-motivated, with a passion for autonomous driving technology and its potential impact on safety and mobility. Nice to have • Experience deploying ML models on embedded or resource-constrained platforms, including model optimization and performance tuning for real-time inference. • Experience with AV/ADAS perception stacks, robotics, or ROS. • Familiarity with safety-critical systems and development practices. • Experience with large-scale data pipelines, labeling workflows, and experiment management for ML. Remote: This role is based remotely but if you live within a 50-mile radius of Atlanta, Austin, Detroit, Warren, Milford or Mountain View, you are expected to report to that location three times per week, at minimum. Compensation : The compensation information is a good faith estimate only. It is based on what a successful applicant might be paid in accordance with applicable state laws. The compensation may not be representative for positions located outside of the California Bay Area. • The salary range for this role is $170,600.00 to $261,300.00. The actual base salary a successful candidate will be offered within this range will vary based on factors relevant to the position. • Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance. Benefits: • Benefits: GM offers a variety of health and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more. This job may be eligible for relocation benefits. #GM-AV-1

About General Motors

General Motors Company engages in the manufacture and sale of cars and trucks in the United States, China, Brazil, Germany, the United Kingdom, Canada, and Italy. It offers sedans, crossovers, sport utility vehicles, pick-up trucks, coupes, sports/convertibles and hybrid vehicles, hatchbacks/wagons, and vans, as well as mini cars in India. The company also provides parts and accessories, such as iPod and MP3 compatibility, mobility accessories, performance parts, AC parts and services, and merchandise. In addition, it offers vehicle safety, security, and information services. The company provides used vehicles. It offers its products through dealers and distributors. General Motors Company was formerly known as NGMCO, Inc. and changed its name to General Motors Company in July 2009. The company was incorporated in 2009 and is based in Detroit, Michigan. It operates manufacturing facilities in India, the United States, and Canada. General Motors Company operates as a subsidiary of the United States Department of The Treasury. General Motors led global vehicle sales for 77 consecutive years from 1931 through 2007, longer than any other automaker, and is currently among the world's largest automakers by vehicle unit sales. General Motors acts in most countries outside the USA via wholly-owned subsidiaries but operates in China through 10 joint ventures. GM's OnStar subsidiary provides vehicle safety, security, and information services. In 2009, General Motors shed several brands, closing Saturn, Pontiac, and Hummer, and emerged from a government-backed Chapter 11 reorganization. In 2010, GM made an initial public offering IPOs to date and returned to profitability later that year.

General Motors Careers

Join the dynamic team at General Motors, a global leader in automotive innovation and technology. At General Motors, we offer unparalleled job opportunities that propel your career forward while contributing to a legacy of engineering excellence.

Work You’ll Do

Embark on a career with General Motors to drive the future of mobility. Our team is dedicated to redefining the automotive landscape through innovation and leadership in electric vehicles and sustainable solutions. By joining us, you will be part of a culture that values diversity, teamwork, and continuous professional growth.

Transform Your Career

General Motors is not just a company; it's a community where you can grow your skills alongside the best in the industry. Our leadership is committed to providing every employee—from interns to senior professionals—with opportunities for career advancement, leadership development, and diversity training.

Innovate and Lead

At General Motors, innovation is at the core of everything we do. From research and development to manufacturing, our teams work collaboratively to lead the industry with cutting-edge technologies and sustainable practices. We encourage our employees to think big and push the boundaries of what’s possible.

Join Our Global Team

As part of our global workforce, you will collaborate with talented individuals who are passionate about shaping the future of transportation. General Motors offers a variety of career paths in engineering, design, IT, marketing, and more. With over 155,000 employees worldwide, our network provides expansive opportunities for networking and professional development.

Internship Programs and Employment Benefits

Start your career journey with a General Motors internship, where you can apply your academic knowledge to real-world projects. Our internships provide a robust foundation in the automotive industry, with mentorship from experienced leaders. Full-time employees enjoy a wealth of benefits, including comprehensive health care, retirement plans, and performance bonuses, ensuring that your hard work is rewarded.

Explore Job Opportunities

Whether you’re a seasoned professional or a recent graduate, General Motors offers positions that leverage your unique skills. Our hiring process is designed to identify and nurture talent, focusing on aligning your capabilities with the right opportunities for growth within the company.

Stay Connected

Join Our Team Search open positions that match your skills and interests. At General Motors, we look for innovative, driven, and solution-oriented team players. Explore the possibilities that await you in a career at General Motors.

Keep Up to Date

Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who drive success at General Motors.

Job Alert Emails

Customize your subscription to receive job alerts, latest news, and insider tips tailored to your preferences. Discover the exciting and rewarding career opportunities available at General Motors. Embark on a journey of growth, innovation, and leadership at General Motors. Shape your future in an environment that fosters diversity, learning, and the pursuit of excellence. Join us and redefine the roads of tomorrow.
Learn more about General Motors
Size
157,000 employees
Market Cap
$46.9 billion
Industry
Net Income
$6.4 billion
Founded
1908
5 Year Trend
-3.2%
Revenue
$122.4 billion
NASDAQ

Similar Jobs

More Jobs at General Motors

More Transportation Jobs

Find similar Senior Machine Learning Perception Engineer - Fallback Driving System jobs: