Scale AI

Senior Machine Learning Engineer, Public Sector

Scale AI$235K — $294K *
Education, Government & Non-Profit
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in building and deploying machine learning systems in production.
  • Expertise in generative AI, agentic AI, NLP, deep learning, or computer vision.
  • Proven track record of owning and defending architectural decisions.
  • Experience with agentic systems handling real production traffic.
  • Strong skills in algorithms, data structures, and OOP.
  • Proficient in Python, with experience in PyTorch or TensorFlow.
  • Experience mentoring engineers.

Responsibilities

  • Own end-to-end design and delivery of agent capabilities.
  • Define new patterns in uncharted problem spaces and lead their development.
  • Deploy state-of-the-art models to solve customer-focused challenges.
  • Maintain and improve production models through various optimization techniques.
  • Develop agent-level evaluation benchmarks and methods to enhance performance.
  • Collaborate with product and research teams on impactful initiatives.
  • Build machine learning infrastructure to optimize ML services.

Benefits

  • Comprehensive health, dental, and vision coverage.
  • Retirement benefits and learning development stipend.
  • Generous paid time off (PTO).
  • Potential for commuter stipend.
Full Job Description
The goal of a Senior Machine Learning Engineer at Scale is to own how we apply generative AI, agentic AI, computer vision, and reinforcement learning to mission-critical problems in production. Our senior machine learning engineers are handed problems that don't yet have an established approach, they propose the architecture, build it with support from other engineers, and are accountable for whether it holds up in the environments our customers depend on.

Our Public Sector Machine Learning team is focused on deploying cutting-edge models to mission-critical government systems through products like Donovan and Thunderforge. Our work spans multiple modalities, with our primary focus on agentic systems built on large language models. We are developing agents that solve complex operational and planning challenges for government partners: agent frameworks that integrate custom retrieval pipelines and production APIs, memory and context-management systems that hold state across long-running tasks, geospatial reasoning over maps and spatial data, and the evaluation tooling that benchmarks and refines agent behavior. We also apply reinforcement learning in targeted places where it earns its keep, and our computer vision work advances evaluation, labeling efficiency, and multimodal model training in support of defense applications.

As a Senior MLE, you'll have design authority over a capability area - the final say on the patterns used within your team, and the responsibility to make those patterns work under real constraints: classified environments, limited compute, and correctness requirements that don't bend.
You will:
  • Own the design and delivery of agent capabilities end to end - architecture, implementation, and the evaluation that proves they work
  • Define net-new patterns in problem spaces with no established approach, propose them to the wider team, and lead the work to build them
  • Take state of the art models developed internally and from the community and put them into production to solve problems for our customers and taskers
  • Improve and maintain production models and agents through retraining, hyperparameter tuning, and architectural updates, while preserving core performance characteristics
  • Build agent-level evaluation benchmarks, LLM judges, and verifiers - and use it to hillclimb performance rather than just report on it
  • Partner with product and research teams to scope and shape high-impact initiatives, including for upcoming product lines
  • Build scalable machine learning infrastructure to automate and optimize our ML services
  • Work directly with government users and subject-matter experts, and translate what you learn into technical direction
  • Act as a force multiplier and a primary reviewer for your team, mentoring at least one engineer, and your manager's go-to on feasibility questions
  • Communicate technical tradeoffs clearly to non-technical stakeholders
  • Treat security and compliance as design constraints to engineer around rather than blockers to route past
  • Serve as a cross-functional representative and advocate for machine learning techniques across engineering and product organizations
  • Be comfortable learning new technologies quickly and managing multiple priorities in a fast-paced environment
  • Comfortable with light travel (approximately 10%) for customer interaction and team needs

This role will require an active TS security clearance
Ideally You'd Have:
  • 5+ years of experience building and deploying applied ML systems in production environments
  • Extensive experience with GenAI, Agentic AI, natural language processing, deep learning and deep reinforcement learning, or computer vision in a production environment
  • A track record of owning architectural decisions and defending the tradeoffs behind them - not just implementing a design handed to you
  • Experience shipping agentic systems with real production traffic and evaluation rigor, rather than prototypes or demos
  • Solid background in algorithms, data structures, and object-oriented programming
  • Strong programming skills in Python, experience in PyTorch or Tensorflow
  • Experience mentoring or reviewing the work of other engineers
Nice to Haves:
  • Graduate degree in Computer Science, Machine Learning or Artificial Intelligence specialization
  • Experience working with cloud platforms (eg. AWS or GCP) and deploying machine learning models in cloud environments
  • Experience with computer vision, generative AI models, large language models, or agentic systems
  • Familiarity with ML evaluation frameworks and agentic model design
  • Experience deploying ML in classified, air-gapped, or IL5+ environments
  • Geospatial or GEOINT experience
  • Inference optimization experience
  • Fine-tuning experience: SFT, RL, or embedding models


Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position and may be inclusive of several career levels at Scale; it will be determined during the interview process based on work location and additional factors, including job-related skills, experience, qualifications, interview performance, and relevant education or training. Scale employees in eligible roles are also granted equity based compensation, subject to Board of Director approval. Your recruiter can share more about the specific salary range for your preferred location during the hiring process, and confirm whether the hired role will be eligible for equity grant. You'll also receive benefits including, but not limited to: comprehensive health, dental and vision coverage, retirement benefits, a learning and development stipend, and generous PTO. Additionally, this role may be eligible for additional benefits such as a commuter stipend.

The base salary range for this full-time position in the location of Washington DC is:

$235,200-$294,000 USD

PLEASE NOTE: Our policy requires a 90-day waiting period before reconsidering candidates for the same role. This allows us to ensure a fair and thorough evaluation of all applicants.

About Scale AI

Scale AI is an artificial intelligence company that provides data annotation services to improve machine learning algorithms. The company's platform offers a range of services including image annotation, text annotation, and 3D annotation. Scale AI was founded in 2016 and is headquartered in San Francisco, California.
Learn more about Scale AI
Size
500 employees
Industry
Founded
2017

Similar Jobs

More Jobs at Scale AI

More Education, Government & Non-Profit Jobs

  • City of Philadelphia
    Commissioner of Labor Relations
    $150K — $250K + excellent benefits package *
    City of Philadelphia
    Philadelphia, PA 19102 (Philadelphia County)
  • State Of Delaware
    Director of Accounting
    $130K *
    State Of Delaware
    Dover, DE 19904 (Kent County)
  • Deputy Building Official
    $80K — $150K + gloucester county government offers an excellent benefit package *
    Gloucester County
    Gloucester, VA 23061 (Gloucester County)
  • Deputy Assessor
    $80K — $150K + gloucester county government offers an excellent benefit package *
    Gloucester County
    Gloucester, VA 23061 (Gloucester County)
  • Civil Engineer II
    $80K — $150K + gloucester county government offers an excellent benefit package *
    Gloucester County
    Gloucester, VA 23061 (Gloucester County)

Find similar Senior Machine Learning Engineer, Public Sector jobs: