Director, AI Engineering

Florence Healthcare - US

$150K — $180K *
Healthcare
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8+ years of software engineering experience in production AI and machine learning systems.
  • 4+ years in a technical leadership role leading engineering teams.
  • Expertise in Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and Agentic AI architectures.
  • Experience building and scaling machine learning pipelines in cloud-native environments.
  • Strong grasp of production ML practices including monitoring, drift detection, and experiment tracking.
  • Proficient in evaluating and integrating new AI technologies into engineering solutions.
  • Excellent communication skills for effective collaboration with various stakeholders.

Responsibilities

  • Lead design and architecture of AI-powered products and platforms.
  • Evaluate and recommend AIl technologies including LLMs and orchestration platforms.
  • Build prototypes and assist teams in resolving complex AI challenges.
  • Mentor AI engineers through technical coaching and design reviews.
  • Drive development of machine learning pipelines from inception to operationalization.
  • Ensure AI solutions are reliable, performant, and maintain high standards.
  • Collaborate with cross-functional teams to define impactful AI capabilities.

Benefits

  • Competitive compensation package with medical and dental insurance.
  • Central office location in a vibrant city.
  • Opportunity to contribute to meaningful health technology innovations.
Full Job Description
What You'll Bring to the Team:

The Director of AI Engineering leads the design, development, and delivery of AI-powered capabilities across Florence products. This is a hands-on technical leadership role responsible for guiding architecture, mentoring engineers, evaluating emerging AI technologies, and partnering closely with engineering teams to deliver scalable, production-ready AI solutions. While this role includes people leadership, success is measured by the ability to help teams solve complex technical challenges and accelerate the delivery of AI capabilities.
You Will:
Technical Leadership & Architecture
  • Lead the technical design and architecture of AI-powered products and platforms.
  • Evaluate and recommend LLMs, AI frameworks, orchestration platforms, and emerging AI technologies.
  • Remain hands-on by building prototypes, validating technical approaches, and helping teams solve complex AI engineering challenges.
  • Review architecture, code, and technical designs to ensure scalable, secure, and maintainable solutions.
  • Guide engineers on best practices for Generative AI, Agentic AI, Retrieval-Augmented Generation (RAG), prompt engineering, and model integration.
  • Mentor AI engineers through technical coaching, design reviews, and pair problem-solving.
AI Engineering Delivery
  • Lead the development and operationalization of machine learning pipelines, including data preparation, feature engineering, model training, validation, deployment, monitoring, and continuous improvement.
  • Drive the best practices and adoption of MLOps practices to enable repeatable, scalable, and reliable machine learning model development and deployment across the organization.
  • Work alongside engineering teams to unblock technical challenges and accelerate delivery.
  • Partner with Product Management to define and implement AI capabilities that solve customer problems.
  • Ensure AI solutions are reliable, observable, performant, cost-efficient and production-ready.
  • Balance rapid experimentation with engineering quality and operational excellence.
AI Platform & Engineering Excellence
  • Design and Enhance Florence's AI platform, including machine learning pipelines , LLM/model orchestration, vector search, Agentic AI frameworks, Model Context Protocol (MCP), AI gateways, Knowledge retrieval systems, evaluation pipelines, feature stores, model serving infrastructur and observability.
  • Establish AI Development Lifecycle (AI DLC) practices, including prompt engineering, evaluation, testing, deployment, monitoring, and governance.
  • Establish engineering standards and reusable patterns that enable teams to deliver AI solutions consistently.
  • Continuously evaluate new AI tools and frameworks to improve developer productivity and product capabilities.
Leadership & Team Development
  • Lead, mentor, and grow a team of AI Engineers and Machine Learning Engineers.
  • Build engineering capabilities across Generative AI, classical Machine Learning, MLOps, and AI platform engineering
  • Provide day-to-day technical guidance and engineering leadership.
  • Foster collaboration, experimentation, and continuous learning across the team.
  • Help engineers develop expertise in modern AI technologies and engineering practices.
Cross-Functional Collaboration
  • Partner with Product Management on AI roadmaps and prioritization.
  • Work closely with Platform/ Product Engineering, Security, DevOps, QA, and Data Engineering teams.
  • Partner closely with Data Engineering and Data Science teams to establish scalable data pipelines, feature engineering practices, and production machine learning workflows.
  • Collaborate with Clinical, Customer Success, and Product teams to deliver impactful AI solutions.
  • Contribute to engineering planning and technical roadmaps.
  • Work closely with Engineering leaders to prioritize AI initiatives and remove delivery risks.
AI Governance & Security
  • Ensure AI systems are secure, reliable, and compliant.
  • Implement guardrails, evaluation frameworks, and responsible AI engineering practices.
  • Partner with Security and Compliance teams on regulated AI deployments.
  • Establish engineering standards for safe AI adoption.


An Ideal Candidate Has:
  • 8+ years of software engineering experience, including significant experience designing, building, deploying, and operating production AI and machine learning systems.
  • 4+ years leading engineering teams in a technical leadership capacity.
  • Strong expertise in Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Agentic AI, prompt engineering, and modern AI application architectures.
  • Experience building and scaling production AI systems, machine learning pipelines, and MLOps platforms in cloud-native environments. .
  • Demonstrated ability to evaluate new AI technologies and translate them into practical engineering solutions.
  • Strong understanding of production machine learning engineering practices, including model performance monitoring, drift detection, experiment tracking, model versioning, and continuous delivery of ML models.
  • Proven experience leading architecture discussions, mentoring technical teams, and influencing engineering direction.
  • Excellent communication skills with the ability to engage effectively with executives, product leaders, and engineering teams.


We'll Be Extra Excited If You Have:

Experience with: Amazon Bedrock, AWS SageMaker, AWS AgentCore, Claude,TensorFlow or PyTorch, Feature Stores, ML Pipeline orchestration tools, OpenAI, Gemini, LangGraph, LangChain, MCP (Model Context Protocol), Kafka, Snowflake, Kubernetes, Docker, Python, MLflow, Vector databases (Pinecone, pgvector, OpenSearch), Healthcare or regulated SaaS environments

Hands-on Technical Expectations:
  • Stay current with advances in Generative AI and AI engineering.
  • Build proof-of-concepts to evaluate new technologies when appropriate.
  • Participate in architecture reviews and technical design sessions.
  • Guide engineers through complex implementation challenges.
  • Contribute to prototypes or reference implementations for strategic initiatives.


What's in it for you?
  • Do well. We offer a competitive compensation package, medical and dental insurance, and office space in the heart of the city.
  • Do good. We insist that health technology is the highest calling for software development. We pride ourselves on working on something bigger than ourselves; helping advance cures and therapies.
  • Make the leap. Join our high-output culture to create innovative, modern, and purposeful software solutions.

Similar Jobs

More Jobs at Florence Healthcare - US

More Healthcare Jobs

Find similar Director, AI Engineering jobs: