Staff Embedded ML Engineer, Edge AI

Hellman & Friedman$185K — $244K *
Technical Services
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8+ years in embedded systems or performance engineering with production experience on constrained devices.
  • Strong C/C++ skills with in-depth knowledge of CPU architecture and memory hierarchy.
  • Experience optimizing ML inference on embedded targets, including operator/kernel tuning.
  • Familiarity with vision model families for optimization (e.g., transformers and CNNs).
  • Experience with on-device inference runtimes like TFLite and TensorRT.
  • Proficient in debugging and profiling techniques for performance investigations.
  • Ability to lead cross-disciplinary teams and define performance benchmarks.

Responsibilities

  • Own embedded deployment and performance of ML inference for outdoor monitoring.
  • Optimize end-to-end inference performance across multiple hardware types (CPU/DSP/NPU/GPU).
  • Perform kernel/operator-level optimizations including vectorization and cache-friendly layouts.
  • Integrate and maintain ML models within embedded pipelines using C/C++.
  • Drive quantization and deployment readiness from an embedded perspective.
  • Build tooling for performance profiling, benchmarking, and regression tracking on devices.
  • Collaborate with ML engineers to translate model changes into deployment impact.

Benefits

  • Mission- and values-driven culture with an inclusive work environment.
  • Comprehensive total rewards package supporting wellness and family security.
  • Free SimpliSafe system and professional monitoring for your home.
  • Employee Resource Groups for networking and development opportunities.
Full Job Description
About the Role

We are seeking a highly motivated and experienced Embedded Machine Learning Engineer to join our growing Edge AI team. As a key contributor, you will lead the on-device inference and performance optimization of ML models powering outdoor monitoring in the home security space. This role is less about inventing new CV architectures and more about making models fast, power-efficient, stable, and shippable on real embedded hardware (outdoor cameras and doorbells). You will operate across the stack (from model runtime integration down to kernel/operator optimization, memory movement, scheduling, and accelerator utilization) to deliver reliable real-time behavior under tight compute, memory, bandwidth, and thermal constraints across device tiers.

Responsibilities:
  • Own the embedded deployment and performance of on-device ML inference for outdoor monitoring workloads (real-time video/event pipelines).
  • Optimize end-to-end inference performance across CPU/DSP/NPU/GPU (as applicable): latency, throughput (FPS), memory footprint, power, thermals, startup time, and stability.
  • Perform kernel/operator-level optimization:
    • vectorization (e.g., SIMD/NEON), tiling, cache-friendly memory layouts
    • reducing bandwidth and memory copies, optimizing post-processing
    • fusing ops, minimizing synchronization/overhead, thread scheduling
  • Integrate and maintain ML models within embedded pipelines:
    • model import/export validation, operator compatibility, graph transforms
    • runtime integration in C/C++ (including pre/post-processing)
    • robust error handling, watchdogs, and safe fallback behavior
  • Drive quantization and deployment readiness from an embedded perspective:
    • validate INT8/FP16 paths, calibration flows, numerical accuracy checks
    • debug quantization edge cases and operator mismatches on target runtimes
  • Build tooling for profiling, benchmarking, and regression tracking on devices:
    • per-layer timing, memory tracking, thermal/perf tests, CI gating
    • automated performance regression gating across device tiers and firmware versions
  • Partner closely with ML engineers to translate model changes into deployment impact; provide constraints and design guidance that improve deployability and performance.
  • Provide Staff-level leadership: set performance standards, lead technical reviews, mentor engineers, and influence platform roadmap for on-device ML.

Qualifications:
  • 8+ years of experience in embedded systems and/or performance engineering, with experience shipping production software on constrained devices.
  • Strong C/C++ expertise with deep knowledge of low-level performance topics: CPU architecture, memory hierarchy, concurrency, and real-time considerations.
  • Demonstrated experience optimizing ML inference on embedded targets, including operator/kernel tuning and end-to-end pipeline optimization.
  • Familiarity with modern vision model families (transformer-based detectors such as DEIM/DFINE/RT-DETR series and CNN-based detectors such as YOLO family or similar) sufficient to optimize their execution characteristics (tensor shapes, attention/conv patterns, post-processing).
  • Experience with on-device inference runtimes and deployment workflows (e.g., TFLite, ONNX Runtime, TensorRT or vendor runtimes), including operator support constraints and graph-level transformations.
  • Strong debugging and profiling skills (perf, flame graphs, hardware counters, tracing) and ability to drive performance investigations to closure.
  • Ability to lead cross-functionally across ML, firmware, and hardware teams; comfortable defining benchmarks/KPIs and making tradeoffs.

Bonus Points:
  • Experience with embedded accelerators and vendor toolchains (DSP/NPU compilers, delegates, GPU compute, custom runtimes).
  • SIMD expertise (ARM NEON/SVE), hand-tuned kernels, or experience with libraries like XNNPACK/QNNPACK/oneDNN/CMSIS-NN (or equivalents).
  • Experience with quantized inference (INT8) at scale: calibration strategies, numerical debugging, overflow/underflow handling, and accuracy-performance tradeoffs.
  • Experience with camera/doorbell pipelines: ISP/video decode/encode, DMA/zero-copy buffers, multi-threaded real-time streaming.
  • Exposure to OS/firmware constraints (embedded Linux, RTOS), power management, thermal throttling behavior, and performance under sustained load.
  • Security/privacy experience for edge devices (secure boot/TEE boundaries, model protection, safe telemetry).
  • Experience building performance regression systems and device-lab automation for continuous benchmarking.

What Values You'll Share
  • Customer Obsessed - Building deep empathy for our customers, putting them at the core of our work, and developing strong, long-term relationships with them.
  • Aim High - Always challenging ourselves and others to raise the bar.
  • No Ego - Maintaining a "no job too small" attitude, and an open, inclusive and humble style.
  • One Team - Taking a highly collaborative approach to achieving success.
  • Lift As We Climb - Investing in developing others and helping others around us succeed.
  • Lean & Nimble - Working with agility and efficiency to experiment in an often ambiguous environment.

What We Offer
  • A mission- and values-driven culture and a safe, inclusive environment where you can build, grow and thrive
  • A comprehensive total rewards package that supports your wellness and provides security for SimpliSafers and their families (For more information on our total rewards please click here)
  • Free SimpliSafe system and professional monitoring for your home.
  • Employee Resource Groups (ERGs) that bring people together, give opportunities to network, mentor and develop, and advocate for change.

The target annual base pay range for this role is $185,500 to $244,600

This target annual base pay range represents our good-faith estimate of what we expect to pay for this role. We use a market-based compensation approach to set our target annual base pay ranges and make adjustments annually. We carefully tailor individual compensation packages, including base pay, taking into consideration employees' job-related skills, experience, qualifications, work location, and other relevant business factors.

Beyond base pay, we offer a Total Rewards package that may include participation in our annual bonus program, equity, and other forms of compensation, in addition to a full range of medical, retirement, and lifestyle benefits. More details can be found here.

We're committed to fair and equitable pay practices, as well as pay transparency. We regularly review our programs to ensure they remain competitive and aligned with our values.

About Hellman & Friedman

Goodman Manufacturing is an American company operating as an independent subsidiary of Daikin Group, the world's largest manufacturer of heating, ventilation and air conditioning products and systems. The company, founded in 1975 and based in Waller, Texas, manufactures residential heating and cooling systems. Goodman is located just outside Houston,Texas, in the $417 million Daikin Texas Technology Park.
Learn more about Hellman & Friedman

Similar Jobs

More Jobs at Hellman & Friedman

More Technical Services Jobs

Find similar Staff Embedded ML Engineer, Edge AI jobs: