Staff Perception Hardware Engineer

Synthesia

$120K — $150K *
Technical Services
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Master or Ph.D. in Electrical Engineering, Optical Engineering, or Computer Engineering with 8+ years of experience in vision hardware integration.
  • Proficient in managing custom perception hardware from prototype through DVT to mass production.
  • Experience in direct collaboration with optical vendors and contract manufacturers for sensor module development.
  • Expert with high-end lab equipment for troubleshooting electrical issues, including EMI and signal integrity disruptions.
  • Strong understanding of optical physics and CMOS sensor performance with practical mitigation techniques.
  • Mastery of calibration methodologies involving multi-camera systems and visual-inertial fusion technologies.
  • Exceptional leadership and consensus-building skills within cross-functional teams.

Responsibilities

  • Lead the physical integration of the visual perception stack for robotic systems.
  • Define specifications for custom sensor modules when off-the-shelf components are inadequate.
  • Create and own validation plans for custom-built sensor modules, ensuring rigorous testing before integration.
  • Oversee hands-on tuning for image quality in real-world scenarios, meeting strict performance requirements.
  • Facilitate the electrical bring-up and debugging of high-speed data links across dynamic robotic joints.
  • Implement precise synchronization for cameras and sensors to ensure high-quality data for machine learning.
  • Design and deploy calibration fixtures and algorithms to solve complex drift issues during production.
  • Act as a technical facilitator among interdisciplinary teams to resolve design conflicts.

Benefits

  • Direct hire opportunity with no outside agency involvement.
  • Collaborative and innovative work environment.
  • Opportunities for mentorship and professional development.
  • Work on cutting-edge robotics technology with real-world applications.
  • Contribute to a successful product from groundwork to deployment.
Full Job Description
The Role

Apptronik is seeking a Staff Perception Hardware Engineer to serve as the execution leader for Apollo's perception hardware systems. While others may draw the block diagrams, you are the engineer responsible for making sure the physical hardware actually works, scales, and ships.

At the Staff level, you will tackle the most complex, multi-disciplinary bottlenecks in the perception stack. You will lead the hands-on integration, aggressive troubleshooting, and physical validation of high-performance cameras, complex optics, and multi-gigabit data links on a moving, vibrating humanoid. You will act as the "boots-on-the-ground" technical authority, leading cross-functional engineering efforts through critical design phases, system bring-up, custom hardware development, ISP tuning, and manufacturing deployment to ensure Apollo perceives the world with unmatched clarity.
Key Responsibilities
  • End-to-End System Execution: Lead the physical integration of the robot's visual perception stack. Drive the transition from prototype designs to fully validated, production-ready camera assemblies, ensuring all FOV, thermal, and mechanical stability targets are met on the physical hardware.
  • Custom Module Development & Vendor Execution: When off-the-shelf components fall short, define the electrical, optical, and mechanical specifications for custom sensor modules. Drive external optical vendors and contract manufacturers (CMs) through the build process, ensuring strict adherence to Apptronik's standards.
  • Custom Bring-Up & Validation Plans: Architect and own the comprehensive bring-up, DVT (Design Verification Testing), and End-of-Line (EOL) test plans for all custom-built sensor modules, ensuring they are rigorously validated before they ever integrate into the humanoid platform.
  • Hands-on ISP Tuning & IQ Validation: Take ownership of the image quality (IQ) on the actual robot. Perform deep, hands-on ISP tuning (auto-exposure, white balance, tone mapping) in real-world environments to ensure the camera data satisfies both the strict requirements of machine learning models and the low-latency needs of human teleoperators.
  • High-Speed Bring-up & Deep Debugging: Lead the electrical bring-up and validation of the multi-gigabit video backbone (e.g., GMSL2/3, FPD-Link). Serve as the ultimate escalation point for complex, system-level EMI/EMC debugging, using high-speed oscilloscopes and analyzers to track down frame drops and signal integrity issues across dynamic robot joints.
  • Synchronization Execution: Implement and rigorously measure the hardware-level synchronization across cameras, LiDAR, and IMUs. Prove out sub-microsecond timing accuracy on the physical robot using oscilloscopes and custom test fixtures to guarantee pristine data for visual-inertial odometry (VIO).
  • Calibration & Fixture Deployment: Design, build, and deploy the physical calibration fixtures and algorithms used to align the optical system. Troubleshoot and resolve complex intrinsic/extrinsic drift issues, ensuring the calibration process scales reliably from the R&D lab to the factory floor.
  • Cross-Functional Adjudication (DfX): Act as the technical adjudicator in the lab between Industrial Design (ID), Mechanical, and Thermal teams. Drive physical testing and prototyping to resolve conflicts between Apollo's iconic A-surface aesthetics, sensor FOV constraints, and thermal dissipation needs.
  • Technical Leadership & Mentorship: Lead complex, cross-functional problem-solving efforts to resolve critical "line-down" or "launch-blocking" hardware bugs. Mentor senior and junior engineers in the lab, establishing a culture of rigorous physical testing and root-cause analysis.
Qualifications
  • Experience: Master or Ph.D degree in Electrical Engineering, Optical Engineering, Computer Engineering, or a related field with 8+ years of hands-on experience integrating and shipping complex vision hardware systems for robotics, autonomous vehicles, or advanced AR/VR platforms.
  • Shipped Product Focus: A proven track record of taking complex perception hardware-including custom-defined sensor modules-from the breadboard phase all the way through DVT and into mass production.
  • Vendor Management: Proven experience working directly with optical vendors, CMOS manufacturers, and CMs to define, build, and test custom camera or sensor modules.
  • Hands-On Troubleshooting Mastery: Expert-level proficiency with high-end lab equipment (high-bandwidth oscilloscopes, logic analyzers, TDRs). You have a "sixth sense" for tracking down ground loops, EMI noise, and intermittent signal integrity issues.
  • Deep Optical & Image Physics: Deep practical understanding of CMOS sensor tuning, optical lens artifacts (flare, ghosting, distortion), and how to physically mitigate them within tight mechanical enclosures.
  • System-Level Math & Calibration: Mastery of the linear algebra and 3D geometry underlying multi-camera arrays, stereo baselines, and visual-inertial sensor fusion, with the ability to write scripts (Python/C++) to validate these models on real hardware.
  • Drive Through Influence: Exceptional ability to lead technical initiatives and align cross-functional stakeholders (Software, ID, and ME) without direct reporting authority, using empirical data from the lab to drive decisions.
  • Agility: Ability to thrive in a fast-paced, high-growth environment where "perfect" is the enemy of "shipped," knowing exactly when a design is robust enough for the real world.


PHYSICAL REQUIREMENTS
  • Prolonged periods of sitting at a desk and working on a computer
  • Must be able to lift 15 pounds at times
  • Vision to read printed materials and a computer screen
  • Hearing and speech to communicate


*This is a direct hire. Please, no outside Agency solicitations.

Similar Jobs

More Jobs at Synthesia

More Technical Services Jobs

Find similar Staff Perception Hardware Engineer jobs: