NTT DATA  Services

AI Application Engineer

NTT DATA Services$130K — $170K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 4+ years in software engineering, 2+ years in LLM application development.
  • 4+ years of Python experience for AI/ML applications and async programming.
  • 3+ years working with multi-step LLM orchestration frameworks like LangChain or LlamaIndex.
  • 3+ years designing and optimizing RAG pipelines and retrieval systems.
  • 3+ years of experience with vector databases and similarity search tuning.

Responsibilities

  • Design, develop, and optimize production-grade LLM applications.
  • Own quality, accuracy, and AI safety for multiple applications.
  • Develop multi-step LLM orchestration pipelines using preferred frameworks.
  • Implement and optimize RAG pipelines with various strategies.
  • Design conversational AI experiences with context and memory management.
  • Integrate NVIDIA technologies into AI applications.
  • Build pipelines for automated model quality evaluation and testing.
  • Optimize latency across multi-step LLM processes.
  • Implement AI safety guardrails to mitigate risks.
  • Collaborate with global teams to deliver scalable AI solutions.

Benefits

  • Collaborative environment with globally distributed teams.
  • Opportunity to work with cutting-edge NVIDIA technologies.
  • Focus on the latest AI advancements in production environments.
  • Autonomy in designing and deploying AI applications.
  • Support for continuous learning and improvement in AI engineering.
Full Job Description
Req ID: 372651

We are currently seeking a AI Application Engineer to join our team in Santa Clara, California (US-CA), United States (US).

We are currently seeking an AI Application Engineer to join our team in Santa Clara, CA.

AI Application Engineer to support the development and delivery of next-generation AI-powered applications built on client infrastructure. This role will focus on production-grade LLM application engineering, RAG quality, prompt engineering, AI safety, and orchestration of complex multi-step AI pipelines.

Responsibilities
  • Design, develop, and optimize production-grade LLM-powered applications.
  • Own AI quality, RAG accuracy, prompt engineering, and AI safety across multiple applications.
  • Develop and maintain multi-step LLM orchestration pipelines using LangChain, LlamaIndex, or custom frameworks.
  • Implement and optimize RAG pipelines including chunking strategies, embedding selection, reranking, and hybrid search.
  • Design multi-turn conversational AI experiences with context management and session memory
  • Integrate NVIDIA technologies including NIM, NeMo, NeMoGuardrails, and Riva into enterprise AI applications.
  • Build automated evaluation pipelines for model quality, hallucination detection, regression testing, and release gating.
  • Perform latency profiling and optimization across multi-step LLM call chains.
  • Implement AI safety guardrails including prompt injection prevention, jailbreak mitigation, and topical control.
  • Collaborate with globally distributed engineering and product teams to deliver scalable AI solutions.
  • Support deployment, monitoring, and continuous improvement of AI applications in production environments.


Qualifications
  • 4+ years of software engineering experience with at least 2 years focused on production LLM application development.
  • 4+ years of experience with Python for AI/ML application development and async programming.
  • 3+ years of experience with multi-step LLM orchestration frameworks such as LangChain or LlamaIndex.
  • 3+ Years of Experience designing and optimizing RAG pipelines and retrieval systems.
  • 3+ Years of Experience with vector databases, similarity search tuning, and reranking techniques.


Position can pay between 130-170K (USD) range annually depending on skills match & suitability.

About NTT DATA Services

NTT DATA Corporation is a Japanese multinational information technology service and consulting company headquartered in Tokyo, Japan. It is partially-owned subsidiary of Nippon Telegraph and Telephone. Japan Telegraph and Telephone Public Corporation, a predecessor of NTT, started Data Communications business in 1967. NTT, following its privatization in 1985, spun off the Data Communications division as NTT DATA in 1988, which has now become the largest of the IT Services companies headquartered in Japan.
Learn more about NTT DATA Services
Size
151,991 employees
Industry
Founded
1988
NASDAQ

Similar Jobs

More Jobs at NTT DATA Services

More Information Technology Jobs

Find similar AI Application Engineer jobs: