AI Software Engineer (GenAI/RAG/Azure AI Foundry) - REMOTE

The Phia Group

$100K — $130K *
US-AnywhereRemote in United States
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, IT, or related field with relevant experience.
  • Strong experience in Python programming, particularly with FastAPI.
  • Hands-on knowledge of Retrieval-Augmented Generation (RAG) architecture and vector databases.
  • Familiarity with deploying applications on Azure services, including AKS.
  • Experience with Docker, Kubernetes, and cloud-native architectures.

Responsibilities

  • Design and implement RAG pipelines utilizing modern vector databases.
  • Build and optimize applications powered by LLMs such as chatbots or automation agents.
  • Leverage AI tools to streamline development processes and enhance code quality.
  • Develop workflows using frameworks that support multi-step decision making.
  • Architect and deploy scalable AI solutions on Azure AI platforms.
  • Integrate AI services into existing enterprise systems, ensuring compatibility with current APIs.
  • Maintain CI/CD pipelines for AI applications, optimizing for performance and reliability.

Benefits

  • Flexible work schedule to promote work-life balance.
  • Opportunities for professional development and training in cutting-edge AI technologies.
  • Dynamic work environment with a focus on innovation and technological advancements.
  • Health, wellness, and wellness programs for a supportive workplace.
Full Job Description
About the Role

We are seeking a forward-thinking AI Software Engineer to design, build, and scale intelligent applications powered by modern AI technologies. This role goes beyond traditional software engineering - focusing on Generative AI, Retrieval-Augmented Generation (RAG), and AI-assisted development using tools like Claude, GPT, and other LLM platforms.

You will play a key role in shaping our AI roadmap by building production-grade AI systems, optimizing developer productivity with AI tools, and integrating intelligent workflows into our healthcare platforms.

Key Responsibilities

AI Engineering & GenAI Development
  • Design and implement RAG (Retrieval-Augmented Generation) pipelines using modern vector databases and embeddings.
  • Build and optimize LLM-powered applications (chatbots, copilots, automation agents).
  • Leverage tools like Claude, GPT, and AI coding assistants to accelerate development and improve code quality.
  • Develop agentic AI workflows using frameworks that enable reasoning, tool usage, and multi-step decision-making.
  • Design and orchestrate multi-agent workflows including orchestrator/supervisor patterns, agent handoffs, and tool routing

Azure AI & Cloud Integration
  • Architect and deploy AI solutions using Azure AI Foundry / Azure OpenAI / Azure ML.
  • Manage scalable deployments using Azure Kubernetes Service (AKS), Docker, and Helm.
  • Implement semantic search and vector indexing using tools like Qdrant or Azure Cognitive Search.
  • Build model-agnostic AI routing layers ( this is to abstract the LLM provider dependencies and create pipelines where we can change models on the fly)

Full-Stack + AI Integration
  • Build and maintain full-stack applications integrating AI services:
    • Frontend: Angular / modern JS frameworks
    • Backend: FastAPI, Spring Boot, Node.js
    • Data: SQL/NoSQL systems
  • Integrate AI services into existing enterprise systems and APIs.

AI-Driven Development & Productivity
  • Use AI tools (Claude, Copilot, etc.) for:
    • Code generation and refactoring
    • Debugging and optimization
    • Test generation and documentation
  • Continuously evaluate and adopt new AI tools to improve engineering velocity.

DevOps & Scalability
  • Build and maintain CI/CD pipelines (Azure DevOps) for AI applications.
  • Optimize system performance, scalability, and reliability of AI workloads.
  • Monitor and improve model performance, latency, and cost efficiency.

Required Qualifications
  • Bachelor's degree in Computer Science, IT, or related field + relevant experience.
  • Strong experience with:
    • Python (FastAPI preferred)
    • Modern backend or full-stack frameworks
  • Hands-on experience with:
    • RAG architecture, embeddings, and vector databases
    • LLMs (GPT, Claude, or similar)
  • Experience deploying applications on Azure (AKS, Azure AI services).
  • Familiarity with Docker, Kubernetes, and cloud-native architectures.
  • Experience with MS SQL, Azure storage, Azure App services, APIM.

Preferred Qualifications
  • Experience with Azure AI Foundry or similar GenAI platforms.
  • Strong understanding of:
    • Prompt engineering
    • Context management in LLMs
    • Fine-tuning / evaluation techniques
  • Experience with vector DBs like Qdrant, Pinecone, or Azure Cognitive Search.
  • Exposure to agent frameworks (LangChain, Semantic Kernel, AutoGen, etc.).
  • Prior experience building AI copilots or internal AI tools.

Working Conditions / Physical Demands
Sitting at workstation for prolong periods of time. Extensive computer work. Workstation may be exposed to overhead fluorescent lighting and air conditioning. Fast paced work environment. Operates office equipment including personal computer, copiers, and fax machines.

This job description is not intended to be and should not be construed as an all-inclusive list of all the responsibilities, skills or working conditions associated with the position. While it is intended to accurately reflect the position activities and requirements, the company reserves the right to modify, add or remove duties and assign other duties as necessary.

Similar Jobs

More Jobs at The Phia Group

More Information Technology Jobs

Find similar AI Software Engineer (GenAI/RAG/Azure AI Foundry) - REMOTE jobs: