Job Description - Senior AI/ML Engineer
Location: Melbourne (hybrid, 3+ days a week in our Melbourne office)
The Opportunity
We're looking for a Senior AI/ML Engineer to join our team and lead projects in AI benchmarking and analysis. You'll work closely with our founders to build core parts of the software stack for our fast-growing startup.
The coming wave of AI scaling is going to change the world in ways we don't yet understand - and we're offering a front row seat.
What You'll Do
• Lead the development and optimization of aspects of our core benchmarking stack, focusing on data intensive backend systems and APIs, and driving projects from concept to shipped
• Design and implement robust Python solutions for benchmarking, model evaluation and data analysis
• Design and implement user interfaces and data visualizations that distill complex AI benchmarking data into intuitive, interactive experiences for thousands of daily users
• Conduct custom analyses for enterprise customers, providing actionable insights to inform their AI strategies
• Contribute to the evolution of our benchmarking methodologies, including development of evaluation methodology for emerging modalities and capabilities
• Embrace an AI-native workflow, using cutting-edge AI tools to generate leverage in a fast-changing industry
What We're Looking For
• 3+ years of professional software engineering experience
• Passion for AI and eagerness to work at the forefront of technological innovation
• Proficiency with relevant Python libraries for data analysis (e.g. pandas) and key AI APIs (e.g. OpenAI)
• Familiarity with cloud infrastructure, orchestration and monitoring tools
• Experience with visualizing and presenting data
• Strong problem-solving skills and ability to distill complex concepts into actionable insights in the face of uncertainty
• Excellent communication and collaboration skills
• Proven ability to lead projects independently in a fast-paced environment
• Bachelor's or Master's in Computer Science, Engineering, or related field (e.g. Physics)
Preferred but not essential:
• Experience with AI/ML frameworks (e.g. PyTorch)
• Creation of analytical reports
