Overview

AI Researcher

Onsite | Ft. Meade, MD

Active TS/SCI w/FS Poly (NSA) Clearance Required

Summary

The AI Researchers provide the technical and analytical foundation for the work. They conduct applied research, define and refine research questions, and perform literature reviews to survey and assess existing methods and emerging approaches. They own experimental design end to end, running experiments, evaluating candidate approaches, and producing publication-quality analysis of the results. They document findings in a form usable by both technical and non-technical stakeholders, contributing to technical reports, evaluation plans, and model and agent assessments. A core part of their role is translating research outcomes into concrete implementation guidance, turning findings and recommendations into direction that the Developers and the broader team can act on. Working closely with the Data Scientists, they shape benchmark design, scoring rationale, and the interpretation of evaluation results so that measured outcomes connect back to the original research objectives.

Upcoming Tasking:

• Develop evaluation methodologies and experimental designs for assessing model and agent performance, including capability, reliability, and limitation analyses.
• Conduct reviews of current state-of-the-art AI/ML evaluation methods and emerging techniques to inform approach selection.
• Define and document evaluation criteria, success metrics, and assessment rationale in partnership with the Data Scientists.
• Assess candidate models and agentic systems and produce written technical findings and recommendations.
• Author technical reports, evaluation plans, and decision-support documentation for stakeholders.
  Technologies / Skills Needed
• Python
• Jupyter notebooks
• Scientific computing libraries
• Machine learning / AI evaluation methods
• Experiment design
• Literature review tools
• Statistical analysis
• Technical writing
• Version control, such as Git
• Collaboration tools such as Jira or Confluence
• Operate effectively in an airgapped/constrained environment

Requirements

• Experience with Applied AI/ML Research, Experimental Design, State-of-the-Art (SOTA) Literature Reviews, Statistical Analysis
• Familiar with conducting Model & Agentic System Capability Assessments, Evaluation Plan Development, Risk & Limitation Analysis
• Experience with Python, Jupyter Notebooks, Scientific Computing Libraries (e.g., NumPy, Pandas, SciPy), Git Version Control
• Comfortable with Technical Writing, Decision-Support Documentation, Executive Reporting, Jira, Confluence

Education/Certification Requirements

• BS in Computer Science or similar technical field (4 years of relevant experience may be substituted in lieu of a BS degree)

Clearance Requirements

• Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; an active TS/SCI w/FS Poly clearance is required. Please note that the FS Poly currently needs to be held by the NSA or within the past two years.

Other Duties

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.