5+ years of experience in backend development in a cloud environment (Python or Java/Spring preferred, AWS an asset)
Good understanding of distributed systems and scalable application design
Ability to solve problems and debug systems with guidance when needed
Comfortable learning new tools, technologies, and best practices
Responsibilities
Contribute to the development lifecycle, including coding, testing, and deployment
Analyze and improve the ease of use, observability, and reliability of our AI platform
Maintain services that handle millions of requests and LLM calls daily
Collaborate with scientists, data engineers, and developers for production integration
Evolve the AI platform to support agentic workflows for users
Suggest process improvements and utilize AI coding tools in development
Benefits
Opportunity to work on a large-scale AI platform influencing millions of machine learning predictions
Collaborative environment with cross-functional teams of applied scientists and engineers
Access to cutting-edge technologies in machine learning and distributed systems
Focus on continuous learning and adapting to new tools and practices
Full Job Description
Build the backbone of AI at scale
Want to see your work power millions of machine learning predictions every day? Join our Machine Learning Platform team and help bring models, including Large Language Models (LLMs), into production in a reliable and scalable way.
You'll contribute to a platform that trains thousands of models and serves hundreds of millions of queries daily, while growing your expertise in distributed systems, machine learning infrastructure and agentic workflows. As a Backend Developer, you will:
Contribute to the development lifecycle, including coding, testing, and deployment
Analyze and help improve the ease of use, observability and reliability of our AI platform
Participate in maintaining services handling millions of requests and LLM calls per day
Collaborate with applied scientists, data engineers, and developers to integrate agentic applications into production
Contribute to evolving our AI platform to support the growth and scale of agentic workflows for Coveo users
Suggest improvements to existing processes and use AI coding tools to support your development workflow
Here is what will qualify you for the role:
5+ years of experience in backend development in a cloud environment (Python or Java/Spring preferred, AWS an asset)
Good understanding of distributed systems and scalable application design
Ability to solve problems and debug systems with guidance when needed
Comfortable learning new tools, technologies, and best practices
What will make you stand out:
Familiarity with Terraform, AWS Bedrock, OpenSearch serverless or other vector databases, LiteLLM or other LLM inference gateways
Exposure to machine learning workflows or agentic workflows
Interest in scalable backend services, large-scale realtime systems, agentic workflows and applications or realtime inference at scale
You don't need to check every single box; passion goes a long way and we appreciate that skillsets are transferable.
Send us your application, we want to hear from you!
Join the Coveolife!
About Coveo
Coveo is a software-as-a-service search engine, powered by artificial intelligence based in Quebec, Canada. The Coveo Relevance Cloud offers ecommerce, customer service, digital workforce, and website search.
