Machine Learning Engineer, AML - Engine (Multiple Positions)

ByteDance

$187K — $316K *
Consumer Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Master's degree or foreign equivalent in a relevant quantitative field, with 1 year of experience; or Bachelor's degree with 3 years of experience.
  • Proficiency in coding with Python or C++.
  • Experience optimizing deep learning training and inference pipelines on GPU and CPU architectures.
  • Hands-on implementation of CUDA-based performance optimizations.
  • Proven ability to enhance systems-level performance across machine learning frameworks.
  • Experience developing and deploying large-scale machine learning systems.
  • Familiarity with big data frameworks like MySQL, Spark, Hadoop, or Flink.

Responsibilities

  • Apply machine learning and robotics research to optimize deep learning model architectures.
  • Design high-performance CUDA kernels for model inference.
  • Analyze computation graphs for optimization opportunities.
  • Utilize parallel computing techniques to enhance throughput and resource utilization in ML workloads.
  • Migrate models between TensorFlow and PyTorch, ensuring performance consistency.
  • Develop optimizations for both in-graph and out-of-graph machine learning computations.

Benefits

  • Day one access to medical, dental, and vision insurance.
  • 401(k) savings plan with company match.
  • Paid parental leave and both short-term and long-term disability coverage.
  • Life insurance and wellbeing benefits.
  • 10 paid holidays and 10 paid sick days annually.
  • 17 days of paid personal time with increasing accrual based on tenure.
Full Job Description
Responsibilities Apply machine learning and robotics research knowledge including LLM and reinforcement learning to analyze and optimize deep learning model architectures. Design and implement high-performance CUDA kernels to accelerate model inference and computation-heavy operators. Analyze computation graphs to identify optimization opportunities across different model structures. Leverage parallel computing techniques such as CUDA and OpenMP to improve throughput, latency, and resource utilization in ML workloads. Migrate between TensorFlow and PyTorch model serving frameworks, ensuring correctness and performance consistency. Develop algorithm-level optimizations for both in-graph and out-of-graph computations, balancing AUC and execution efficiency. Qualification Qualifications Must have a Master's degree or foreign equivalent degree in Computer Science, Engineering (any), Information Technology, Data Science, Robotics, Mathematics, or a related quantitative field, and 1 year of related work experience; OR a Bachelor's degree or foreign equivalent degree in Computer Science, Engineering (any), Information Technology, Data Science, Robotics, Mathematics, or a related quantitative field, and 3 years of related work experience. Of the required experience, must have 1 year of experience in each of the following: Coding using Python or C++; Optimize deep learning training and inference pipelines on GPU and CPU architectures; Implement CUDA-based performance optimizations for machine learning workloads; Improve systems-level performance across machine learning frameworks; Developing and deploying large-scale machine learning systems; and Utilizing Big data framework using MySQL, Spark, Hadoop, or Flink. Type: Full time, 40 hours/week Location: San Jose, CA Salary Range: $187741 - $316800 per year To Apply, click the apply button below. Contact [redacted] if you have difficulty submitting resume through the website. Job Information 【For Pay Transparency】Compensation Description (Annually) The base salary range for this position in the selected city is $187741 - $316800 annually. Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units. Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure). The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

Similar Jobs

More Jobs at ByteDance

More Consumer Technology Jobs

Find similar Machine Learning Engineer, AML - Engine (Multiple Positions) jobs: