Senior Staff Developer, AI and Machine Learning

Benevity

• $125K — $150K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's degree in Computer Science, Mathematics, or related field, or equivalent professional experience.
  • 8+ years of software engineering experience with 4+ years architecting ML models in production.
  • 2+ years in a technical leadership role focusing on scalable platforms and transformation.
  • Experience building internal platforms for engineering team use, not just product features.
  • Deep expertise in MLOps and production ML systems from training to management.

Responsibilities

  • Design and oversee robust end-to-end ML architecture for model training and monitoring.
  • Define the long-term roadmap for AI infrastructure and orchestration.
  • Implement and maintain the AI/ML ecosystem.
  • Create self-service AI capabilities for other teams to utilize independently.
  • Establish MLOps standards to ensure ecosystem testability and maintainability.
  • Lead cross-functional collaborations to translate business needs into technical requirements.
  • Mentor engineers on design and optimization through high-level reviews.

Benefits

  • Collaborative work environment with cross-functional teams.
  • Opportunities to shape the future of AI and ML technology.
  • Mentorship and professional development opportunities.
  • Engagement in impactful projects with measurable business value.
  • Potential for innovative work on generative AI applications.
Full Job Description
This is a brand new role designed to shape the future of our engineering organization. As Senior Staff Developer - AI and Machine Learning, you will serve as the technical anchor for our machine learning and AI efforts, leading the end-to-end architecture of our GenAI strategy. You will bridge the gap between theoretical research and production-grade engineering-designing the scalable systems that power our model training, deployment, and monitoring. We are looking for a rare combination of deep technical mastery and strategic leadership to ensure our AI initiatives deliver high-impact, measurable business value. What you'll do: • Design and oversee the development of robust end-to-end ML architecture, from data ingestion and feature stores to model serving and monitoring. • Define the long-term roadmap strategy for our AI infrastructure and orchestration framework. • Oversee the design, implementation, and maintenance of our AI/ML ecosystem. • Design AI capabilities as extensible, self-service primitives (APIs, SDKs, standardized patterns) that let other domain teams build their own AI-powered features independently. • Set the standard for MLOps - you will ensure that our ML ecosystem is as testable, maintainable, and scalable as our core application code. • Cross-functional leadership - by working closely with Product Managers, Data Scientists and ML Engineers to translate business problems into concrete technical requirements. • Act as a force multiplier for the team by conducting high-level design reviews and mentoring engineers on system design and performance optimization. • Architect and evolve LLM-powered applications (e.g., copilots, search, assistants, agents), including RAG pipelines, tool integrations, and multi-step reasoning workflows. • Design and implement robust evaluation frameworks for GenAI systems, incorporating offline benchmarks, online metrics, and human-in-the-loop feedback. • Drive best practices for prompt engineering, agent design, and orchestration frameworks, ensuring maintainability and performance at scale. • Establish guardrails and safety mechanisms for GenAI applications, including prompt injection defenses, hallucination mitigation, and responsible AI practices. • Establish the golden path for model versioning, A/B testing, and automated rollbacks for identifying and mitigating drifts. • Ensure AI architectural strategy aligns with industry best practices and standards, complies with security policies and industry regulations. • Identify opportunities for process improvements and implement solutions to enhance platform performance and efficiency. What you'll bring: • Bachelor's or Master's degree in Computer Science, Mathematics, or a related field, or equivalent deep professional experience. • 8+ years of software engineering experience, with at least 4+ years architecting and deploying ML models in production at scale. • 2+ years in a technical leadership role on building scalable platforms, technology transformation and modernization initiatives. • Proven experience operating at a Staff or Senior level, including technical leadership, architecture ownership, and mentoring engineers. • Experience building internal platforms/self-service infrastructure for other engineering teams to build on, not just shipping product features directly. • Deep expertise in MLOps and production ML systems, including model training, evaluation, deployment, monitoring, and lifecycle management. • Strong experience with cloud platforms (AWS or Google Cloud), including designing and operating scalable, distributed AI/ML workloads. • Solid understanding of data architecture and data engineering, including data pipelines, feature engineering, data modeling, and large-scale data processing. • Experience with ML infrastructure and tooling, such as feature stores, experiment tracking, model registries, and orchestration frameworks. • Proficiency in Python and ML frameworks (e.g., TensorFlow, PyTorch, scikit-learn), with strong software engineering fundamentals. • Experience with CI/CD and ML deployment pipelines, including automated testing, validation, and rollback strategies for ML systems. • Familiarity with LLM-based systems and GenAI applications, including systems design, evaluation strategies, and observability for non-deterministic systems. • Strong understanding of LLM architectures and trade-offs, including model selection, latency, cost, and quality optimization. • Experience with prompt engineering and prompt orchestration, including techniques like few-shot learning, chain-of-thought, and tool/function calling. • Experience designing and implementing RAG (Retrieval-Augmented Generation) systems, including embedding strategies, vector databases, and retrieval optimization. • Experience building agentic workflows, including multi-step reasoning, tool use, and orchestration frameworks (e.g., LangChain, LlamaIndex, ADK, or custom frameworks). • Strong understanding of system design for reliability and scalability, including distributed systems, APIs, and microservices architecture. • Knowledge of data governance, model governance, and responsible AI practices (security, privacy, bias, explainability). • Demonstrated ability to translate ambiguous business problems into scalable AI/ML solutions. • Excellent communication and collaboration skills, with the ability to influence stakeholders and drive cross-functional alignment. Great-to-haves: • Certification in relevant cloud platforms or technologies.

Similar Jobs

More Jobs at Benevity

More Information Technology Jobs

Find similar Senior Staff Developer, AI and Machine Learning jobs: