Senior Staff Developer, AI and Machine Learning

Benevity

• $125K — $150K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's degree in Computer Science, Mathematics, or related field, or equivalent professional experience.
  • 8+ years of software engineering experience, with at least 4+ years in deploying ML models in production at scale.
  • 2+ years in a technical leadership role focusing on scalable platforms and technology transformation.
  • Proven experience in technical leadership and mentoring engineers, particularly at the Staff or Senior level.
  • Experience in building internal platforms for self-service infrastructure.

Responsibilities

  • Design and oversee robust end-to-end ML architecture encompassing data ingestion to model monitoring.
  • Define the long-term strategy for AI infrastructure and orchestration framework.
  • Implement and maintain the AI/ML ecosystem, ensuring high efficiency and scalability.
  • Create extensible AI capabilities (APIs, SDKs) that empower other teams to develop AI-powered features.
  • Establish standards for MLOps to enhance the testability and maintainability of the ML ecosystem.
  • Collaborate with cross-functional teams to convert business needs into technical solutions.
  • Lead design reviews and mentor engineers in system design and optimization.

Benefits

  • Flexible working hours and remote work options.
  • Opportunities for professional development and continuous learning.
  • Embedded culture of innovation and experimentation.
  • Supportive team environment promoting cross-disciplinary collaboration.
  • Access to cutting-edge technology and AI tools.
Full Job Description
This is a brand new role designed to shape the future of our engineering organization. As Senior Staff Developer - AI and Machine Learning, you will serve as the technical anchor for our machine learning and AI efforts, leading the end-to-end architecture of our GenAI strategy. You will bridge the gap between theoretical research and production-grade engineering-designing the scalable systems that power our model training, deployment, and monitoring. We are looking for a rare combination of deep technical mastery and strategic leadership to ensure our AI initiatives deliver high-impact, measurable business value. What you'll do: • Design and oversee the development of robust end-to-end ML architecture, from data ingestion and feature stores to model serving and monitoring. • Define the long-term roadmap strategy for our AI infrastructure and orchestration framework. • Oversee the design, implementation, and maintenance of our AI/ML ecosystem. • Design AI capabilities as extensible, self-service primitives (APIs, SDKs, standardized patterns) that let other domain teams build their own AI-powered features independently. • Set the standard for MLOps - you will ensure that our ML ecosystem is as testable, maintainable, and scalable as our core application code. • Cross-functional leadership - by working closely with Product Managers, Data Scientists and ML Engineers to translate business problems into concrete technical requirements. • Act as a force multiplier for the team by conducting high-level design reviews and mentoring engineers on system design and performance optimization. • Architect and evolve LLM-powered applications (e.g., copilots, search, assistants, agents), including RAG pipelines, tool integrations, and multi-step reasoning workflows. • Design and implement robust evaluation frameworks for GenAI systems, incorporating offline benchmarks, online metrics, and human-in-the-loop feedback. • Drive best practices for prompt engineering, agent design, and orchestration frameworks, ensuring maintainability and performance at scale. • Establish guardrails and safety mechanisms for GenAI applications, including prompt injection defenses, hallucination mitigation, and responsible AI practices. • Establish the golden path for model versioning, A/B testing, and automated rollbacks for identifying and mitigating drifts. • Ensure AI architectural strategy aligns with industry best practices and standards, complies with security policies and industry regulations. • Identify opportunities for process improvements and implement solutions to enhance platform performance and efficiency. What you'll bring: • Bachelor's or Master's degree in Computer Science, Mathematics, or a related field, or equivalent deep professional experience. • 8+ years of software engineering experience, with at least 4+ years architecting and deploying ML models in production at scale. • 2+ years in a technical leadership role on building scalable platforms, technology transformation and modernization initiatives. • Proven experience operating at a Staff or Senior level, including technical leadership, architecture ownership, and mentoring engineers. • Experience building internal platforms/self-service infrastructure for other engineering teams to build on, not just shipping product features directly. • Deep expertise in MLOps and production ML systems, including model training, evaluation, deployment, monitoring, and lifecycle management. • Strong experience with cloud platforms (AWS or Google Cloud), including designing and operating scalable, distributed AI/ML workloads. • Solid understanding of data architecture and data engineering, including data pipelines, feature engineering, data modeling, and large-scale data processing. • Experience with ML infrastructure and tooling, such as feature stores, experiment tracking, model registries, and orchestration frameworks. • Proficiency in Python and ML frameworks (e.g., TensorFlow, PyTorch, scikit-learn), with strong software engineering fundamentals. • Experience with CI/CD and ML deployment pipelines, including automated testing, validation, and rollback strategies for ML systems. • Familiarity with LLM-based systems and GenAI applications, including systems design, evaluation strategies, and observability for non-deterministic systems. • Strong understanding of LLM architectures and trade-offs, including model selection, latency, cost, and quality optimization. • Experience with prompt engineering and prompt orchestration, including techniques like few-shot learning, chain-of-thought, and tool/function calling. • Experience designing and implementing RAG (Retrieval-Augmented Generation) systems, including embedding strategies, vector databases, and retrieval optimization. • Experience building agentic workflows, including multi-step reasoning, tool use, and orchestration frameworks (e.g., LangChain, LlamaIndex, ADK, or custom frameworks). • Strong understanding of system design for reliability and scalability, including distributed systems, APIs, and microservices architecture. • Knowledge of data governance, model governance, and responsible AI practices (security, privacy, bias, explainability). • Demonstrated ability to translate ambiguous business problems into scalable AI/ML solutions. • Excellent communication and collaboration skills, with the ability to influence stakeholders and drive cross-functional alignment. Great-to-haves: • Certification in relevant cloud platforms or technologies.

Similar Jobs

More Jobs at Benevity

More Enterprise Technology Jobs

Find similar Senior Staff Developer, AI and Machine Learning jobs: