AI Backend Engineer

Prophecy Technologies

$120K — $150K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Strong Python and AI/ML fundamentals.
  • Hands-on experience in prompt engineering.
  • Experience integrating pretrained/foundation models into enterprise applications.
  • Proficiency in deploying AI solutions using CI/CD.
  • Versatility in constructing AI pipelines using LangChain, LlamaIndex, and AutoRAG.
  • Experience with model optimization through Optuna and GridSearchCV.
  • Familiarity with Python microservices and APIs (FastAPI/Flask/Django).

Responsibilities

  • Implement Python microservices and APIs (FastAPI/Flask/Django) with clean contracts and versioning.
  • Build REST/GraphQL endpoints and SDKs for AI-enhanced features.
  • Implement asynchronous and event-driven processing for high throughput.
  • Integrate services with enterprise AI platforms/LLM APIs and manage prompt orchestration.
  • Enforce runtime guardrails for input sanitization and output validation.
  • Implement semantic retrieval and vector search using approved platforms.

Benefits

  • Opportunities for professional growth and skill development.
  • Collaborative and innovative work environment.
  • Access to cutting-edge AI technologies and tools.
Full Job Description
Role Overview:

This role is for an AI Backend Engineer, also described as a Python Full Stack Developer, with strong Python and AI/ML fundamentals. The position focuses on hands-on experience in prompt engineering, integrating pretrained/foundation models into enterprise applications, and deploying AI solutions using CI/CD. The engineer will be versatile in constructing AI pipelines using tools like LangChain, LlamaIndex, and AutoRAG, with an emphasis on model optimization through Optuna and GridSearchCV.

Key Responsibilities:
  • Implement Python microservices and APIs (FastAPI/Flask/Django) with clean contracts, versioning, pagination, and rate limiting.
  • Build REST/GraphQL endpoints and internal SDKs to enable AI enhanced features (prompt routing, retrieval, redaction) while maintaining strict separation from model ownership.
  • Implement asynchronous and event driven processing (e.g., Celery/Kafka/queues) for high throughput pipelines and background jobs.
  • Integrate services with enterprise AI platforms / LLM APIs (e.g., Azure OpenAI via enterprise gateway), handling prompt orchestration, tool invocation, moderation hooks, and response validation.
  • Enforce runtime guardrails: input sanitization, PII redaction, toxicity/NSFW filters, output signing, and fallbacks.
  • Implement semantic retrieval and vector search via approved platforms; do not train or host custom models.

Required Skills:
  • Strong Python and AI/ML fundamentals.
  • Hands-on experience in prompt engineering.
  • Experience integrating pretrained/foundation models into enterprise applications.
  • Proficiency in deploying AI solutions using CI/CD.
  • Versatility in constructing AI pipelines using LangChain, LlamaIndex, and AutoRAG.
  • Experience with model optimization through Optuna and GridSearchCV.
  • Familiarity with Python microservices and APIs (FastAPI/Flask/Django).
  • Knowledge of REST/GraphQL endpoints and internal SDKs.
  • Experience with asynchronous and event-driven processing (e.g., Celery/Kafka/queues).
  • Ability to integrate with enterprise AI platforms / LLM APIs (e.g., Azure OpenAI).
  • Understanding of prompt orchestration, tool invocation, moderation hooks, and response validation.
  • Capability to implement runtime guardrails including input sanitization, PII redaction, toxicity/NSFW filters, output signing, and fallbacks.
  • Experience with semantic retrieval and vector search.

Qualifications:
  • No specific years of experience mentioned.

Preferred Skills:

Similar Jobs

More Jobs at Prophecy Technologies

More Information Technology Jobs

Find similar AI Backend Engineer jobs: