Position Title: AI/ML Data Specialist
Location: Remote (Washington, DC metro area preferred); place of performance is 395 E Street SW, Washington, DC
Client: U.S. Department of Transportation, Surface Transportation Board (STB)
Work Authorization: Must be eligible for a Moderate Risk (MBI level) background investigation prior to accessing STB systems
Application Email: To apply, please submit your resume to
[email protected] or complete the application form below.
Job Summary WINTrio LLC is seeking an experienced AI/ML Data Specialist to design and deploy advanced AI capabilities that improve data discovery, access, and operational efficiency for a federal agency. This role centers on building retrieval augmented generation (RAG) capabilities and secure AI driven knowledge access tools, all developed and governed in compliance with OMB M-26-04.
Key Responsibilities - Build automated document ingestion and indexing pipelines for unstructured content.
- Develop RAG capabilities to support internal information retrieval, combining retrieval of relevant internal documents or data with generation of summarized, cited answers. Models must not invent answers; they must read internal content and respond based on it, with citations and security trimming.
- Deploy secure AI driven knowledge base and query services appropriate for internal federal use.
- Define and implement evaluation metrics covering accuracy, reliability, bias, and error rate.
- Establish AI guardrails, including monitoring, usage boundaries, and human oversight where appropriate.
- Produce comprehensive documentation for models, data flows, interfaces, and evaluation results.
- Meet performance standards including 90%+ accuracy and reliability, Retrieval Precision of 0.90 or higher, and Citation coverage of 0.95 or higher.
- Ensure all AI solutions comply with OMB M-26-04 and other applicable federal requirements.
Required Qualifications - Demonstrated experience building RAG pipelines, including retrieval and generation components with citation and security trimming.
- Experience with document ingestion, indexing, and unstructured data processing.
- Experience defining and applying AI evaluation metrics, including accuracy, bias, and reliability testing.
- Experience establishing AI guardrails, monitoring, and human oversight practices.
- Familiarity with federal AI governance requirements, including OMB M-26-04.
- Experience working in a federal or regulated environment with stakeholders, CORs, and structured deliverables.
- Must be eligible for a Moderate Risk (MBI) background investigation.
Technical Skills & Tools - RAG & LLM Tooling: retrieval systems, generation models, citation and security trimming
- Document Processing: ingestion and indexing pipelines for unstructured content
- Evaluation & Guardrails: accuracy, reliability, bias, and error rate metrics; usage monitoring and human oversight
- AWS Cloud Services (preferred): integration with existing AWS based data environment
- Recommended Certifications (not mandatory): AWS Certified Machine Learning Specialty
Work Environment - Full time or part time position, based on contract activation.
- Remote eligible; contractor services may be performed remotely per the contract's terms.
- Standard business hours Monday through Friday.
- No travel required.
WINTrio Benefits - Healthcare (Medical, Dental, and Vision)
- Flexible Spending Account (FSA) and Health Savings Account (HSA)
- 401(k) and Retirement Savings Plan
- Annual Bonus and Profit Sharing Opportunities
- Paid Time Off (PTO) and Vacation
- Employee Assistance Program (EAP)
- Life, Personal, and Voluntary Disability Insurance
Growth Opportunities There is ample opportunity to grow in multiple dimensions, including federal AI program development, applied machine learning leadership, and emerging technology strategy. We are a completely employee driven company, and our continued success is built on the talent, dedication, and innovation of our team members.
