Senior Machine Learning Engineer

TetraMem Inc

$200K — $280K *
Consumer Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years in machine learning or a PhD in a related field.
  • Demonstrated experience in a leadership role, managing a team.
  • Strong hands-on knowledge of edge AI and on-device inference.
  • Expertise in ML frameworks like PyTorch and TensorFlow.
  • Proficiency in Python and C/C++ for model deployment.
  • In-depth understanding of model compression techniques for edge inference.
  • Experience with AI chip SDKs and hardware-specific toolchains.

Responsibilities

  • Develop, optimize, and deploy machine learning models for edge AI applications.
  • Implement ML models on embedded platforms such as FPGA and ASIC.
  • Integrate ML models into production systems with hardware and software teams.
  • Research and apply state-of-the-art ML techniques for efficiency and power consumption.
  • Enhance model inference efficiency through various compression techniques.
  • Collaborate with cross-functional teams to foster innovation in system architecture.
  • Provide mentorship and technical guidance to junior engineers.

Benefits

  • Opportunities for team leadership and personal mentorship.
  • Participation in research publishing and conference presentations.
  • Engagement in open-source project contributions.
  • Collaboration with cutting-edge hardware and software technologies.
  • Access to advanced training and professional development resources.
Full Job Description
Responsibilities:
  • Develop, optimize, and deploy lightweight machine learning models for edge AI applications, particularly for audio processing.
  • Implement and optimize ML models on embedded platforms, including FPGA and custom ASIC solutions.
  • Work closely with hardware and software teams to integrate ML models into production systems.
  • Research and implement state-of-the-art ML techniques to enhance model efficiency, latency, and power consumption for embedded AI applications.
  • Improve inference efficiency and model compression techniques, including quantization, pruning, and knowledge distillation.
  • Collaborate with cross-functional teams to drive innovation and contribute to the overall system architecture.
  • Provide technical leadership and mentorship to junior engineers.
  • Publish research findings, present at conferences, and contribute to open-source projects when applicable.

Requirements:
  • 5+ years of relevant industry experience (or a PhD) in Computer Science, Electrical Engineering, Machine Learning, or related fields.
  • Must have prior experience managing a team, serving in a Team Lead role, or demonstrating strong technical leadership and cross-functional coordination capabilities.
  • Strong hands-on experience in machine learning, with a focus on edge AI, on-device inference, and deploying lightweight models on resource-constrained devices.
  • Expertise in modern ML frameworks such as PyTorch, TensorFlow (including TensorFlow Lite), and JAX.
  • Proficiency in Python and C/C++, with practical experience in ML model optimization and production deployment.
  • Deep experience with model quantization (PTQ/QAT), pruning, knowledge distillation, sparsity, and other compression techniques for efficient edge inference.
  • Hands-on experience developing for or integrating with AI chip SDKs, neural accelerators (NPUs/DSPs), or hardware-specific toolchains (e.g., NVIDIA TensorRT, Qualcomm Neural Processing SDK, ARM Ethos, or similar).
  • Familiarity with edge inference runtimes (ONNX Runtime, ExecuTorch, TVM) and optimizing models for hardware constraints (latency, memory footprint, power consumption).

Experience in one or more of the following areas considered a strong plus:
  • Understanding of ML compiler and runtime design.
  • Experience working with tools such as Optimum, ONNX, TensorRT, TFLite/LiteRT, ncnn, or CoreML.
  • Familiarity with hardware acceleration techniques.
  • Experience in embedded system development.

Salary Range: $200,000 - $280,000 / year

Similar Jobs

More Jobs at TetraMem Inc

More Consumer Technology Jobs

Find similar Senior Machine Learning Engineer jobs: