Modern Technology Solutions

AI Architect & RAG Data Science Engineer

Modern Technology Solutions • $110K — $130K *
Huntsville, AL 35810In-Person
Enterprise Technology
Less than 5 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 4+ years of experience in enterprise data, analytics, AI/ML, or cloud environments.
  • Bachelor's degree in AI, ML, data science, computer science, or related field; equivalent experience considered.
  • Deep understanding of agentic AI and Retrieval-Augmented Generation (RAG) systems.
  • Knowledge of search algorithms: BM25, TF-IDF, embeddings, and reranking methods.
  • Strong programming skills in Python and familiarity with one additional OOP language (Java, C#, etc.).
  • Familiar with SQL and secure software development practices.
  • Ability to effectively communicate complex technical concepts to diverse stakeholders.

Responsibilities

  • Translate operational needs into RAG solution designs and measurable outcomes.
  • Design secure RAG implementations including metadata management and hybrid retrieval.
  • Apply search methods to enhance recall and precision in data retrieval.
  • Develop and maintain data quality evaluations and performance metrics.
  • Contribute to user experience through API development and workflow orchestration.
  • Integrate diverse technical data and maintain data provenance.
  • Utilize DevSecOps principles for automated deployment, monitoring, and versioning.
  • Solve complex technical problems and communicate solutions to stakeholders.

Benefits

  • Work in a mission-driven environment with a focus on securing and improving AI capabilities.
  • Opportunity to lead advanced projects involving cutting-edge AI technologies.
  • Collaboration with skilled professionals and experts across various fields.
  • Flexible telework options available for qualified candidates.
  • Engagement in projects that have significant impact on defense and technical domains.
Full Job Description
MTSI is looking for a "Big Data" Scientist and AI Architect to deliver key technical leadership on an ongoing and funded MTSI "STRIKE" IRAD. This IRAD is focused on bringing data taxonomy, data meta-tagging and quality data processes to large dis-organized test data sets and tailoring AI Agents to rapidly locate key data packages needed for model development. More details on the IRAD will be provided to qualified candidates in the interview.

POSITION SUMMARY (as IRAD technical lead)
  • Serves as an AI Architect and RAG Data Science Engineer supporting the design, delivery, and continuous improvement of a secure Retrieval-Augmented Generation (RAG) capability. The position requires the individual to design secure, full-stack AI/ML architectures spanning data ingestion, APIs, model services, retrieval, applications, and deployment infrastructure.
  • The role translates mission needs into governed data products and full-stack AI services that convert distributed technical, engineering, test, and telemetry information into traceable, role-appropriate answers and analytics. Working with technical and program leadership, the incumbent contributes hands-on expertise across AI/ML, software, cloud, cyber, data engineering, systems engineering, and test.


MISSION FOCUS: Deliver trustworthy, secure, and measurable AI-enabled knowledge access and decision support across constrained enterprise and mission environments.

PRINCIPAL RESPONSIBILITIES:
  • Mission and architecture delivery: Translate operational, test, and sustainment needs into RAG solution designs, delivery increments, acceptance criteria, and measurable decision-support outcomes under established program priorities.
  • Secure RAG and agent implementation: Design and implement capabilities spanning source onboarding, document parsing and normalization, metadata and taxonomy management, hybrid retrieval, reranking, LLM inference, citations, guardrails, and agentic workflows using controlled tool use and handoffs; apply llama.cpp or comparable local inference runtimes where permitted.
  • Search and retrieval engineering: Apply search methods including BM25, TF-IDF, embeddings, hybrid retrieval, metadata filtering, and reranking to improve recall, precision, traceability, and user trust in technical knowledge retrieval.
  • Data science and assurance: Develop data-quality, retrieval-relevance, groundedness, faithfulness, latency, usefulness, and safety evaluations; maintain curated test sets, analytic baselines, experiments, and performance dashboards to support evidence-based releases.
  • Full-stack delivery: Contribute to secure user experiences, RESTful APIs, application services, workflow orchestration, data stores, vector databases, integration patterns, and observability needed to operate an AI product at enterprise scale.
  • Data and telemetry integration: Partner with engineering, test, and data owners to integrate structured and unstructured technical data, test artifacts, logs, sensor or platform telemetry, and operational knowledge while preserving provenance and access controls.
  • DevSecOps and MLOps: Apply Git-based development, automated testing, CI/CD, containerization, vulnerability management, model and data versioning, monitoring, auditability, and repeatable deployment across approved environments.
  • Collaboration and complex problem resolution: Help decompose ambiguous technical problems involving fragmented data, conflicting sources, constrained networks, evolving requirements, performance tradeoffs, and mission risk; document findings and communicate workable alternatives to technical and program stakeholders.


REQUIRED QUALIFICATIONS
  • Four or more years of professional experience delivering software, data, analytics, AI/ML, cloud, or data-platform capabilities in an enterprise, regulated, mission-critical, or defense-adjacent environment.
  • Bachelor's degree in artificial intelligence, machine learning, data science, computer science, engineering, applied mathematics, or a related discipline; equivalent relevant experience may be considered where permitted by contract.
  • Deep practical understanding of agentic AI and RAG systems, including tool use, multi-step orchestration, retrieval design, prompt and model orchestration, source traceability, evaluation, and responsible-AI controls; experience with llama.cpp and OpenCode or comparable approved tools.
  • Working knowledge of search and retrieval algorithms including BM25, TF-IDF, vector embeddings, hybrid retrieval, metadata filtering, and reranking.
  • Strong programming and engineering foundation using Python and at least one additional object-oriented language such as Java, C#, or comparable technologies; familiarity with Git, debugging, build workflows, and code review practices.
  • Working knowledge of SQL, structured and unstructured data pipelines, APIs, service-oriented architectures, document processing, vector search, web or frontend integration, containers, CI/CD, and secure software development practices.
  • Ability to communicate technical designs, delivery risk, test evidence, and operational implications clearly to technical, government, contractor, and nontechnical stakeholders.


PREFERRED QUALIFICATIONS
  • Master's degree or active graduate-level study in AI, ML, data science, computer science, engineering, or a closely related field.
  • Experience with Kubernetes, cloud-native platforms, infrastructure as code, GitLab, GitHub Actions, Azure DevOps, or comparable automated delivery toolchains.
  • Experience operating AI, analytics, telemetry, digital engineering, test, or sustainment solutions in Department of Defense, aerospace, aviation, or similarly constrained environments.
  • Experience implementing model evaluation, observability, safety or policy guardrails, identity-aware access controls, and data or model provenance for generative-AI systems.
  • Experience leading Agile or hybrid delivery teams and integrating AI products with enterprise systems, secure networks, edge deployments, or disconnected operations.


CONTRACTOR, SECURITY, AND WORK CONDITIONS
  • Must be a U.S. citizen and able to obtain and maintain the security clearance, base access, and eligibility for classified, controlled, or other restricted environments required by the contract.
  • Performs contractor technical support and advisory functions only; command, acquisition, operational, and inherently governmental decisions remain with authorized government officials.
  • Preferred location is the Huntsville, AL area but will consider telework with incremental alignment travel for the right candidate.
  • Work may require onsite presence at government or company facilities, collaboration across secure and non-secure networks, CONUS or OCONUS travel, surge support, and adjustment to evolving mission priorities.


#LI-AS1

About Modern Technology Solutions

Modern Technology Solutions, Inc. (MTSI) is a leading-edge engineering and technology company that provides critical solutions for complex military and commercial programs. MTSI has been providing engineering and technical services to the defense industry since 1993. The company has a strong focus on innovation and is committed to delivering the best solutions to its clients. MTSI has a highly skilled workforce of engineers, scientists, and technical experts who are dedicated to providing the highest quality services to its clients. The company has a proven track record of success and has received numerous awards and recognition for its work.
Learn more about Modern Technology Solutions
Size
1,000 employees
Industry
Information Technology
Founded
1993
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Modern Technology Solutions

More Enterprise Technology Jobs

Find similar AI Architect & RAG Data Science Engineer jobs:

NationwideHuntsville, AL