Staff Software Engineer, AI Governance

SCAN Group

$106K — $182K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8+ years of software engineering experience, with 3+ years in production ML systems or AI safety infrastructure.
  • Proven success in designing end-to-end solutions in enterprise-scale environments.
  • Strong proficiency in Python and a systems language like Go, Java, or C++.
  • Deep knowledge of LLM architectures and traditional ML algorithms.
  • Experience with enterprise AI proxy layers for PHI data protection.
  • Familiarity with LLM-specific security vulnerabilities, like OWASP Top 10 for LLMs.
  • Ability to adapt commercial AI models for safe integration into healthcare workflows.

Responsibilities

  • Design and maintain AI governance platforms with automated compliance features.
  • Implement deterministic guardrails for autonomous AI systems to adhere to HIPAA regulations.
  • Establish engineering standards and best practices for responsible AI deployment.
  • Mentor engineers and drive technical roadmaps for AI safety.
  • Propose architectural improvements for integration platforms and tools.
  • Enhance the performance and reliability of production integrations.
  • Ensure compliance with healthcare regulations while collaborating with security and legal teams.

Benefits

  • Annual employee bonus program.
  • Robust Wellness Program.
  • Generous paid-time-off (PTO) including 11 paid holidays and extra days for volunteering or birthdays.
  • 401(k) retirement saving plan with employer match.
  • Tuition reimbursement program.
  • Opportunity to positively impact the community and members.
Full Job Description
The Job

Serves as the Staff technical engineer and visionary responsible for building the infrastructure, tooling, and frameworks that ensure our Artificial Intelligence and Machine Learning systems are safe, compliant, transparent, and trustworthy.

This is a high-impact, cross-functional role. You will bridge the gap between cutting-edge AI engineering, legal compliance, and ethical safety standards. You will design and implement scalable systems to monitor, audit, and govern large language models (LLMs), predictive models, and autonomous agents across the entire enterprise product lifecycle.

You Will:
  • Architecture & Core Engineering: Design, build, and maintain enterprise-grade AI governance platforms, including automated pipelines for model lineage, bias detection, drift monitoring, and compliance auditing.
  • Agentic Guardrails & Orchestration: Design and enforce deterministic guardrails for autonomous AI agents, ensuring agent reasoning loops cannot execute actions that bypass HIPAA controls or data boundaries.
  • Standards & Frameworks: Establish engineering standards, best practices, and internal processes for reproducible ML and responsible AI deployment.
  • Technical Leadership: Mentoring mid-level and senior engineers, driving technical roadmaps, and making critical architecture decisions regarding AI safety.
  • Integration Platform Direction: Contribute to the technical direction of the integration platform by proposing and implementing improvements to architecture, tools, and technologies.
  • Production Reliability: Identify and resolve performance bottlenecks, troubleshoot integration issues, and proactively improve the reliability of integrations in production environments.
  • Healthcare Compliance & Security: Ensure all integration work adheres to healthcare compliance and security standards, including HIPAA, HL7, and FHIR, while collaborating with security teams to protect sensitive data.
  • Cross-Functional Collaboration: Partner closely with Legal, Compliance, Security, Data Privacy, and AI Research teams to translate complex regulatory requirements into concrete, automated technical solutions. Vendor assessment and risk management along with secure LLM integrations.


Your Qualifications:

Required:
  • Experience: 8+ years of professional software engineering experience, with at least 3+ years specifically focused on production ML systems, MLOps, or AI safety infrastructure.
  • Architecture Decision-Making: Proven track record of designing and implementing end-to-end solutions and making successful architectural decisions in complex, enterprise-scale environments.
  • Programming Mastery: High proficiency in Python and at least one systems language (e.g., Go, Java, C++).
  • AI/ML Expertise: Strong understanding of LLM architectures, transformer models, retrieval-augmented generation (RAG), and traditional ML algorithms.
  • Building/assessing enterprise-grade AI proxy layers and tools to automatically detect, redact, or anonymize PHI before data reaches external LLM APIs
  • Familiarity with LLM-specific security vulnerabilities (e.g., OWASP Top 10 for LLMs)
  • Adapting commercial AI models (like OpenAI or Anthropic) into healthcare workflows safely.


Preferred:
  • Education: B.S. or M.S. in Computer Science, Data Science, or a related technical field (or equivalent practical experience).


What Success Looks Like:
  • In 3 Months: Map out the existing AI/ML deployment pipeline, identify critical governance gaps, and deliver a technical roadmap for automated compliance auditing.
  • In 6 Months: Launch the first version of our centralized AI Governance, enabling product teams to seamlessly integrate model tracking, bias testing, and safety guardrails into their existing CI/CD workflows.
  • In 12 Months: Establish a comprehensive, real-time AI risk-monitoring dashboard that successfully scales to support all enterprise-wide AI systems, ensuring 100% compliance with relevant regulatory standards.


What's in it for you?
  • Base salary range: $106,200 to $182,983 annually
  • An annual employee bonus program
  • Robust Wellness Program
  • Generous paid-time-off (PTO)
  • 11 paid holidays per year, 1 floating holiday, birthday off, and 2 volunteer days
  • Excellent 401(k) Retirement Saving Plan with employer match
  • Robust employee recognition program
  • Tuition reimbursement
  • An opportunity to become part of a team that makes a difference to our members and our community every day!


We're always looking for talented people to join our team! Qualified applicants are encouraged to apply now!

Similar Jobs

More Jobs at SCAN Group

More Enterprise Technology Jobs

Find similar Staff Software Engineer, AI Governance jobs: