AI Architect - Generative AI & Agentic AI (GCP)

Prophecy Technologies

$130K — $180K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Strong experience in Generative AI and Agentic AI architectures
  • Hands-on expertise with LLMs, LangGraph, LangChain
  • Strong background in Machine Learning and Deep Learning
  • Proficiency in Python
  • Experience with Java (Spring Boot) for API and service development
  • Extensive experience with Google Cloud Platform (GCP) and Vertex AI
  • Strong understanding of MLOps and LLMOps practices
  • Experience designing secure, enterprise-grade AI platforms

Responsibilities

  • Lead end-to-end AI architecture for enterprise products on Google Cloud Platform (GCP)
  • Architect solutions across Generative AI (GenAI), Agentic AI, classical ML/DL, and scalable microservices
  • Define reference architectures and manage the model and pipeline lifecycle
  • Guide engineering teams across Python and Java stacks
  • Design and implement GenAI and Agentic AI solutions including LLM selection and optimization
  • Build LangGraph or LangChain agent workflows for multi-step planning and orchestration
  • Ensure security, governance, and compliance for AI solutions

Benefits

  • Opportunities for professional development and training
  • Access to cutting-edge technologies
  • Flexible working arrangements
  • Collaboration with cross-functional teams
  • Work in a dynamic, innovative environment
Full Job Description
Job Summary

The AI Architect will lead the design and delivery of enterprise-scale AI solutions on Google Cloud Platform (GCP). This role focuses on Generative AI, Agentic AI, and classical Machine Learning/Deep Learning, enabling secure, scalable, and high-performance AI platforms using Python and Java technologies.

Key Responsibilities
  • Lead end-to-end AI architecture for enterprise products on Google Cloud Platform (GCP).
  • Architect solutions across Generative AI (GenAI), Agentic AI, classical ML/DL, and scalable microservices.
  • Define reference architectures and manage the model and pipeline lifecycle.
  • Guide engineering teams across Python and Java stacks to industrialize:
  • Large Language Models (LLMs)
  • LangGraph / LangChain agent workflows
  • Secure and reliable AI platforms
  • Design and implement GenAI and Agentic AI solutions, including:
  • LLM selection and optimization
  • Prompt engineering strategies
  • Tool usage and grounding techniques
  • Build LangGraph or LangChain agent workflows for multi-step planning, orchestration, and safe execution.
  • Develop ML/DL solutions including:
  • Supervised and unsupervised learning
  • NLP use cases
  • Vector search, embeddings, and RAG pipelines
  • Model evaluation using TensorFlow and PyTorch
  • Architect and deploy solutions using GCP services, including:
  • Vertex AI (training, endpoints, evaluation)
  • BigQuery
  • Dataflow / Apache Beam
  • Pub/Sub
  • Cloud Storage
  • IAM, KMS, and networking
  • Develop production-grade applications using:
  • Python (frameworks, packaging, testing)
  • Java (Spring Boot) for model APIs and microservices
  • Apply best practices for performance, scalability, and reliability.
  • Establish and manage MLOps and LLMOps, including:
  • Model versioning and registries
  • CI/CD pipelines
  • Feature stores and vector databases
  • Monitoring, telemetry, and alerting
  • Quality gates, red-teaming, and risk evaluation
  • Collaborate with offshore and cross-functional teams to deliver AI/ML solutions at scale.
  • Ensure security, governance, and compliance, including:
  • PII / PHI protection
  • Encryption in transit and at rest
  • Data retention policies
  • Audit readiness and governance standards

Required Skills & Experience
  • Strong experience in Generative AI and Agentic AI architectures
  • Hands-on expertise with LLMs, LangGraph, LangChain
  • Strong background in Machine Learning and Deep Learning
  • Proficiency in Python
  • Experience with Java (Spring Boot) for API and service development
  • Extensive experience with Google Cloud Platform (GCP) and Vertex AI
  • Strong understanding of MLOps and LLMOps practices
  • Experience designing secure, enterprise-grade AI platforms

Competencies
  • Digital : Python
  • Digital : Google Cloud Platform
  • Digital : AI & Generative AI - Products & Tools
  • Core : Java

Preferred Skills
  • Experience with agentic workflows and multi-agent architectures
  • Strong understanding of enterprise governance, compliance, and risk management
  • Experience leading architecture and mentoring engineering teams

Similar Jobs

More Jobs at Prophecy Technologies

More Information Technology Jobs

Find similar AI Architect - Generative AI & Agentic AI (GCP) jobs: