Johns Hopkins University

Assistant Research Scientist (PREP0004937)

Johns Hopkins University$80K — $95K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • U.S. Citizen Preferred
  • Experience in AI research, measurement science, or related fields
  • Proven background in designing and evaluating AI agents and autonomous systems
  • Experience developing benchmarks and evaluation methodologies for AI systems
  • Demonstrated ability to translate research into practical industry applications
  • Familiarity with AI architectures, human-AI interaction, and AI safety
  • Strong analytical and communication skills within multidisciplinary settings

Responsibilities

  • Design, develop, and evaluate agentic AI systems and architectures
  • Build experimental platforms and prototypes for AI capabilities assessment
  • Conduct advanced research on trustworthy approaches for AI systems
  • Develop benchmarks and test methodologies for agent performance evaluation
  • Investigate challenges in autonomous decision-making and agent coordination
  • Collaborate with internal and external experts to enhance AI practices
  • Support transition of research outcomes into practical solutions for stakeholders

Benefits

  • Opportunities for research and laboratory experience
  • Financial support throughout the program
  • Collaboration with a multidisciplinary team
  • Access to cutting-edge research in AI
  • Engagement with government and industry stakeholders
Full Job Description
PREP Research Associate

This position is part of the National Institute of Standards and Technology (NIST) Professional Research Experience Program (PREP). The PREP program provides valuable research and laboratory experience, as well as financial support, to researchers at various stages of their academic and professional careers. Individuals in this position will perform technical work that advances scientific research and measurement science across multiple disciplines.

Research Title: Research Associate - Agentic Artificial Intelligence (AI) Scientist

Position Description

The Agentic Artificial Intelligence (AI) Scientist will serve as a technical expert in the design, development, evaluation, and deployment of trustworthy AI agents and agentic AI systems. The successful candidate will contribute to cutting-edge research focused on supporting the development of methodologies, benchmarks, and best practices that enable the safe, secure, reliable, and effective use of AI agents across a range of application domains.

The position will support research activities related to AI agents, multi-agent systems, tool-using AI systems, human-AI collaboration, and emerging agentic AI architectures. The successful candidate will also contribute to the transition of research outcomes into practical solutions, guidance, and standards-related activities that advance trustworthy and responsible adoption of agentic AI technologies.

Key Responsibilities include, but are not limited to:

Technical Development and Implementation:
• Design, develop, and evaluate AI agents and agentic AI systems. Develop and implement architectures for autonomous and human-supervised AI agents, including multi-agent and tool-integrated systems.
• Build experimental platforms, prototypes, and proof-of-concept demonstrations to assess agentic AI capabilities and limitations.

Research and Technical Analysis:
• Conduct advanced research and technical analyses to develop and evaluate trustworthy approaches for agentic AI systems.
• Develop methodologies, benchmarks, testbeds, and measurement techniques to assess agent performance, reliability, safety, robustness, explainability, and human oversight.
• Investigate challenges associated with autonomous decision-making, agent coordination, tool use, planning, memory, and adaptive behavior.
• Evaluate risks and failure modes associated with agentic AI systems, including unintended actions, misuse, autonomy-related risks, and security vulnerabilities.

Technical Collaboration and Coordination:
• Collaborate with researchers and technical experts across NIST and external partner organizations to advance the science and practice of trustworthy agentic AI.
• Evaluate emerging agentic AI technologies and assess their applicability to multidisciplinary use cases.

Technology Transition and Stakeholder Engagement:
• Support the transition of research outcomes into practical tools, frameworks, guidance documents, and operational capabilities for government and industry stakeholders.
• Engage with external partners to identify challenges, opportunities, and emerging requirements for AI agents and autonomous systems.

Qualifications
U.S. Citizen Preferred
• Experience conducting research and measurement science in artificial intelligence, machine learning, large language models (LLMs), agentic AI, multi-agent systems, or related fields.
• Experience designing, developing, evaluating, or deploying AI agents, autonomous systems, retrieval-augmented generation (RAG) systems, tool-using AI systems, or LLM-based applications.
• Experience developing benchmarks, evaluation methodologies, testbeds, frameworks, or pilot implementations for AI systems.
• Demonstrated ability to transition research outcomes into practical applications that deliver measurable impact to industry or government stakeholders.
• Familiarity with AI orchestration frameworks, agent architectures, human-AI interaction, AI safety, AI security, or autonomous system evaluation.
• Strong analytical, technical, and communication skills, with the ability to collaborate effectively in multidisciplinary research environments.

Application Instructions

Please upload the following with your application:
• CV/Resume

*Please limit C.V to 3 pages only and ONLY include a valid email address for your contact info. Your resume will not be considered if the following information is included on your CV/resume.
Self portraits
Phone number
Home address/Country
Citizenship status
Languages spoken
Sex/Gender

About Johns Hopkins University

Johns Hopkins University is a private research university that was founded in 1876. The university offers undergraduate, graduate, and doctoral programs in various fields, including arts and sciences, engineering, business, education, medicine, nursing, and public health. Johns Hopkins University is known for its research in the areas of medicine, public health, and engineering. The university has a strong commitment to community service and social justice, and it has been ranked as one of the top universities in the United States.
Learn more about Johns Hopkins University
Size
51,000 employees
Industry
Founded
1876

Similar Jobs

  • National Institute of Standards and Technology
    Assistant Research Scientist (PREP0004962)
    $80K — $95K *
    National Institute of Standards and Technology
    Gaithersburg, MD 20878 (Montgomery County)
  • PPG Industries
    Research Chemist, Polymer Film
    $80K — $95K *
    PPG Industries
    Monroeville, PA 15146 (Allegheny County)
  • Biologist
    $85K — $102K *
    National Institutes of Health
    Frederick, MD 21702 (Frederick County)
  • Biologist
    $80K — $95K *
    National Institutes of Health
    Durham, NC 27713 (Durham County)
  • Biologist
    $80K — $95K *
    National Institutes of Health
    Rockville, MD 20850 (Montgomery County)
  • Data Scientist
    $95K — $115K *
    Veterans Affairs
    West Haven, CT 06516 (South Central Ct County)

More Jobs at Johns Hopkins University

More Information Technology Jobs

Find similar Assistant Research Scientist (PREP0004937) jobs: