LLM Backend Engineer Graduate (Applied Machine Learning) - 2027 Start

ByteDance

$128K — $256K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's degree in Computer Science or related field
  • Proficiency in a programming language (Golang, Java, C++, or Python)
  • Experience in software development and solid computer science fundamentals
  • Familiarity with backend engineering systems, databases, and distributed systems
  • Hands-on experience in server-side engineering preferred
  • Knowledge of cloud-native technologies like Kubernetes and Docker preferred
  • Interest in large model inference pipelines is a plus

Responsibilities

  • Design and develop core components of the Volcano Ark MaaS platform
  • Participate in cloud-native architecture evolution and implement high-availability solutions
  • Perform system-level performance tuning for streaming and low latency
  • Ensure system stability during large-scale model invocations
  • Resolve architectural bottlenecks from sudden traffic spikes

Benefits

  • Day one access to medical, dental, and vision insurance
  • 401(k) savings plan with company match
  • Paid parental leave
  • Short-term and long-term disability coverage
  • Life insurance and wellbeing benefits
  • 10 paid holidays and 10 paid sick days per year
  • 17 days of Paid Personal Time with increasing accruals by tenure
Full Job Description
Responsibilities: - Design and develop core components of the Volcano Ark MaaS platform, supporting API capabilities for text dialogue, multimodal understanding, and multimodal generation. - Participate in cloud-native architecture evolution, including Service Mesh, load balancing, and intelligent routing; design and implement high-availability solutions such as end-to-end grayscale release, traffic degradation, circuit breaking, and rate limiting. - Perform system-level performance tuning for long connections, high throughput, streaming output, and low latency in multimodal large model inference scenarios. - Ensure system stability for large-scale model invocation scenarios and resolve architectural bottlenecks caused by sudden traffic spikes. Qualification Minimum Qualifications: - Individuals who are completing or have recently completed a Bachelor's or Master's degree in Computer Science or a related discipline. - Proficient in at least one programming language such as Golang, Java, C++, or Python; has practical software development experience and solid computer science fundamentals. - Understands basic backend engineering systems, including databases, computer networks, operating systems, and distributed system principles. Preferred Qualifications: - Hands-on experience in server-side engineering. - Understanding of Agent concepts and related technical implementations, such as Function Calling and MCP. - Familiarity with cloud-native and service mesh technologies such as Kubernetes, Docker, Istio, and Envoy. - Interest in large model inference pipelines, with relevant background knowledge. Job Information 【For Pay Transparency】Compensation Description (Annually) The base salary range for this position in the selected city is $128000 - $256000 annually. Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units. Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure). The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

Similar Jobs

More Jobs at ByteDance

More Information Technology Jobs

Find similar LLM Backend Engineer Graduate (Applied Machine Learning) - 2027 Start jobs: