Senior Software Engineer - Machine Learning (Remote US)

Legion Intelligence

$230K — $270K *
US-AnywhereRemote in United States
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's degree in Computer Science, Machine Learning, or equivalent experience.
  • 5+ years in building production software systems.
  • Strong programming skills in Rust, Python, or similar languages.
  • Experience with scalable backend services and distributed systems.
  • Hands-on integration of large language models into production applications.
  • Ability to evaluate and optimize AI systems through experimentation.
  • Solid understanding of software engineering best practices.

Responsibilities

  • Design and maintain core AI capabilities for the platform.
  • Develop reusable model integration and foundational AI functionality.
  • Optimize AI systems for reliability and performance through experimentation.
  • Build backend services, APIs, and distributed AI systems.
  • Collaborate with product teams to deploy scalable AI services.
  • Prototype emerging AI techniques for production readiness.
  • Support production systems by debugging and improving operational performance.

Benefits

  • Remote work opportunity within the USA.
  • Collaborative engineering culture focused on ownership and learning.
  • Exposure to cutting-edge AI techniques and foundation models.
  • Opportunity to work with cross-functional teams on innovative projects.
Full Job Description
Staff Applied Machine Learning Engineer (Remote USA)

***US Citizenship or Greencard is required due to US Government contract requirements***
Senior Software Engineer, Machine Learning

As a Senior Software Engineer, Machine Learning, you will design, build, and evolve the core AI capabilities that power intelligent experiences across our enterprise AI platform. You will integrate modern foundation models into production systems, develop reusable AI capabilities, and continuously improve their quality, reliability, and performance. Working closely with cross-functional teams, you will transform advances in AI into secure, scalable, and production-ready capabilities that accelerate innovation across the platform.
Responsibilities
  • Design, build, and maintain the core AI capabilities that power intelligent experiences across the platform.
  • Develop reusable capabilities for model integration, reasoning, multimodal understanding, structured generation, evaluation, and other foundational AI functionality.
  • Optimize the AI systems that power these capabilities through experimentation, quantitative evaluation, context engineering, and iterative refinement.
  • Apply your production software engineering experience to build backend services, APIs, and distributed AI systems.
  • Partner closely with cross-functional partners to deploy scalable AI services that enable product teams to rapidly build AI-powered experiences.
  • Rapidly prototype emerging AI techniques and translate successful experiments into production-ready platform capabilities.
  • Support production systems by debugging failures and continuously improving latency, reliability, observability, and operational performance.
  • Stay current with advances in AI engineering, foundation models, and applied machine learning, applying them where they create meaningful customer value.
  • Optimize AI systems for performance, latency, reliability, scalability, and cost.
  • Contribute to a collaborative engineering culture focused on ownership and continuous learning.
Required Skills and Qualifications
  • Bachelor's or Master's degree in Computer Science, Machine Learning, or a related technical field, or equivalent practical experience.
  • 5+ years of experience building production software systems.
  • Strong software engineering skills with experience in Rust, Python, or similar programming languages.
  • Proven ability to build scalable backend services, distributed systems, APIs, or data-intensive applications.
  • Hands-on experience integrating large language models or other foundation models into production applications.
  • Ability to design, evaluate, and improve AI systems through experimentation, quantitative evaluation, and continuous iteration.
  • Familiarity with modern AI engineering patterns such as structured outputs, tool calling, context engineering, multimodal systems, or AI workflows.
  • Strong understanding of software engineering best practices, including testing, observability, reliability, and maintainability.
  • Demonstrated ability to take ownership of technically ambiguous projects from design through production.
  • Excellent communication and collaboration skills with the ability to work effectively across cross-functional teams.
  • Growth mindset and low ego, with a willingness to learn, adapt, and collaborate.
Preferred Skills and Qualifications
  • Experience building reusable AI capabilities or shared AI services.
  • Familiarity with deploying, optimizing, or serving open-source foundation models.
  • Knowledge of evaluation frameworks, benchmarks, or datasets for AI applications.
  • Experience with Kubernetes, cloud-native infrastructure, or distributed systems.
  • Experience developing production software in Rust.
  • Familiarity with retrieval-augmented generation (RAG), multimodal AI, AI agents, or model orchestration.
  • Domain expertise building complex AI systems such as multimodal reasoning, long-running inference workflows, AI agents, or model orchestration.


Compensation Information

$230,000-$270,000 USD

Similar Jobs

More Jobs at Legion Intelligence

More Information Technology Jobs

Find similar Senior Software Engineer - Machine Learning (Remote US) jobs: