Bill & Melinda Gates Foundation

Senior AI Engineer (*3-Year LTE)

Bill & Melinda Gates Foundation$203K — $314K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in a technical field or equivalent experience, with 5+ years in production software development.
  • Strong backend engineering skills, capable of debugging unfamiliar code and delivering reliable services.
  • Proficient in Python and AI frameworks like PyTorch or Hugging Face.
  • Experience building applications driven by large language models (LLM) and retrieval-augmented generation (RAG).
  • Familiar with designing and operating backend APIs in cloud environments, preferably Azure.
  • Track record in AI evaluative processes, focusing on quality, cost, and latency assessment for models.
  • Hands-on experience with data pipelines, ETL processes, MLOps workflows, and cloud data services.

Responsibilities

  • Design and build AI systems with multi-step workflows and autonomous task orchestration as backend services.
  • Construct and manage retrieval systems, ensuring effective data ingestion and knowledge retrieval processes.
  • Create AI evaluation pipelines to monitor system improvements and performance.
  • Architect and maintain scalable backend services and APIs for engineering and research teams.
  • Make high-level architectural decisions and mentor engineers on AI application patterns.
  • Develop workflows leveraging Azure technologies like Azure AI Foundry and Databricks.
  • Transform successful prototypes into reliable production systems, ensuring comprehensive testing and documentation.

Benefits

  • 36-month limited-term position based in Seattle, WA, with relocation support provided.
  • Opportunity to work on impactful projects in global health and development.
  • Collaborative environment with IDM researchers and external partners.
  • Engagement with cutting-edge technologies in AI and cloud services.
Full Job Description

Your Role

We are looking for a senior generalist engineer who is energized by designing and building modern AI systems agents, retrieval pipelines, evaluation harnesses, and the backend services that hold them together. You are passionate about well-architected software, you make pragmatic build-vs-buy and self-host-vs-API calls, and you reach for the simplest approach that actually solves the problem. You will work on projects with real-world impact for global public good, integrated into a collaborative, mission-driven team alongside IDM researchers and their internal and external collaborators. You will be essential in turning AI ideas into working systems agents, services, evaluations, and the connective tissue that lets a small team ship a lot.

*This is a 36-month limited-term position based in Seattle, WA. Relocation will be provided.

What You’ll Do

  • Design and build agentic AI systems — multi-step workflows, tool use, and autonomous task orchestration using modern LLM frameworks — and ship them as reliable backend services.
  • Build and operate retrieval systems: ingestion, chunking, embeddings, vector search, and knowledge-graph-backed retrieval where it earns its keep.
  • Design AI evaluation pipelines and benchmarks so the team can tell whether an agent, model, or retrieval system is actually getting better — and monitor them in production.
  • Architect, implement, and maintain scalable backend services and APIs that other engineers, researchers, and applications build on top of.
  • Make senior-level architectural calls — model choice, hosting (Azure OpenAI vs. self-hosted), framework selection, and infrastructure tradeoffs — and mentor other engineers on AI application patterns.
  • Develop data pipelines and workflows leveraging Azure (Azure AI Foundry, Azure OpenAI, Azure AI Search, Azure Databricks) and Hugging Face.
  • Harden successful prototypes into production: tests, observability, cost and latency monitoring, failure handling, and documentation that let other people trust and reuse them.
  • Collaborate directly with researchers, analysts, and program staff to translate fuzzy domain problems into shippable systems for global health and global development.
  • Identify knowledge, data, or tooling gaps in the settings in which we work and propose pragmatic solutions.

Your Experience

  • Bachelor’s degree in a technical field with 5+ years building production software, or equivalent experience. Advanced degree is a plus, not required.
  • Strong general-purpose backend engineering: you can pick up unfamiliar code, debug across systems, and ship services that hold up in use.
  • Proficiency in Python, including for AI work (e.g., PyTorch, Hugging Face, or similar).
  • Hands-on experience building LLM-powered applications: retrieval-augmented generation (RAG), agentic workflows, tool use, and prompt engineering at production scale.
  • Experience designing and operating backend APIs and services in cloud environments — ideally Azure, but AWS or GCP equivalents are fine.
  • Experience building AI evaluations and observability — measuring quality, cost, and latency of LLM systems and acting on the results.
  • Hands-on experience with data pipelines and ETL, MLOps/AI Ops workflows, and cloud data services.
  • Experience with Git, CI/CD, containerization (Docker), infrastructure-as-code, and broader DevOps practices.
  • Comfort making and defending architectural tradeoffs (managed service vs. self-host, fine-tune vs. prompt, agent vs. workflow) and mentoring others through them.
  • Comfort working directly with researchers and non-engineers — able to translate fuzzy problems into concrete software, and to push back when the simplest answer is “we don’t need to build that.”
  • Track record of taking projects from prototype to something other people rely on.

Other Attributes

  • Experience with vector databases, knowledge graphs, or information architecture for AI applications.
  • Experience with fine-tuning, distillation, or other model adaptation techniques.
  • Exposure to scientific, public health, geospatial, or climate-related datasets.
  • Engagement with the open-source AI community.
  • Ability to stand up lightweight interactive demos (Streamlit, Gradio) when needed to show work to non-engineering stakeholders.
  • Publications, patents, or other public artifacts that show depth in an area — but not required and not weighted over shipped work.

**Must have unrestricted work authorization in the country where this position is located. The Foundation does not provide immigration-related sponsorship for this role. This includes direct company sponsorship and any work authorization requiring a written submission or other immigration support from the company (eg: H-1B, O-1, L-1, E, OPT, STEM-OPT, CPT, TN, J-1, etc.).

The salary range for this role is $186,400 to $288,800 USD. We recognize high-wage market differences in Seattle and Washington D.C., where our offices are located. The range for this role in these locations is $203,100 to $314,900 USD. As a mission-driven organization, we strive to balance competitive pay with our mission. New hire salaries are typically between the range minimum and the salary range midpoint. Actual placement in the range will depend on a candidate’s job-related skills, experience, and expertise, as evaluated during the interview process.

#LI-CM1

About Bill & Melinda Gates Foundation

The Bill & Melinda Gates Foundation is a private foundation founded by Bill and Melinda Gates. The foundation was launched in 2000 and is based in Seattle, Washington. The primary goals of the foundation are to enhance healthcare and reduce extreme poverty, and to expand educational opportunities and access to information technology. The foundation is one of the largest charitable organizations in the world, with an endowment of over $50 billion. The foundation has made significant contributions to global health, including the eradication of polio in India and the development of new vaccines for malaria and tuberculosis. The foundation also supports a variety of educational initiatives, including the development of new technologies for teaching and learning.
Learn more about Bill & Melinda Gates Foundation
Size
1,600 employees
Industry
Founded
2000

Similar Jobs

More Jobs at Bill & Melinda Gates Foundation

More Information Technology Jobs

Find similar Senior AI Engineer (*3-Year LTE) jobs: