OverviewWe are seeking a highly technical and hands-on
Generative AI Engineering Lead to lead the design, development, and operationalization of enterprise Generative AI solutions. This role combines deep
Generative AI and LLM engineering expertise with strong
AWS cloud and solution architecture capabilities and formal leadership responsibility for a team of approximately
3-5 engineers.
The Generative AI Engineering Lead will be responsible for designing and building production-grade AI solutions spanning
Large Language Models (LLMs), AI agents, Retrieval-Augmented Generation (RAG), Model Context Protocol (MCP), semantic search, APIs, and cloud-native architectures. The individual will work closely with the Enterprise Architect to define new solutions, evolve existing architectures, establish engineering patterns, and ensure solutions align with enterprise architecture, security, governance, and operational requirements.
This is a
hands-on engineering role. The successful candidate will be expected to contribute directly to solution architecture, application design, coding, prototyping, troubleshooting, code reviews, and technical delivery while providing day-to-day technical leadership to the engineering team.
The individual will also serve as an advocate for modern AI engineering practices and will champion the responsible use of
Generative AI to accelerate the Software Development Life Cycle (SDLC) and improve engineering productivity.
ResponsibilitiesGenerative AI Solution Engineering- Lead the architecture, design, development, and implementation of enterprise Generative AI and LLM-powered applications.
- Build production-ready solutions using foundation models, prompt engineering, RAG, AI agents, semantic search, and related Generative AI patterns.
- Evaluate model capabilities, limitations, and tradeoffs and recommend appropriate models and architectures based on business and technical requirements.
- Develop reusable AI components, frameworks, patterns, and services that can be leveraged across multiple applications and use cases.
- Maintain a strong hands-on engineering presence by developing application components, prototypes, integrations, APIs, and reference implementations.
AI Agents & Agentic Workflows- Design and implement agentic AI solutions capable of executing complex, multi-step workflows.
- Build agent architectures incorporating:
- Tool and function calling
- Workflow orchestration
- State and memory management
- Planning and reasoning patterns
- Human-in-the-loop workflows
- Multi-agent collaboration
- Error handling and recovery
- Design and implement stateful and multi-agent workflows using LangChain and LangGraph.
- Establish patterns for safely integrating autonomous and semi-autonomous AI agents into enterprise systems.
Retrieval-Augmented Generation (RAG)- Architect and implement end-to-end RAG solutions, including:
- Document ingestion and preprocessing
- Document parsing and chunking strategies
- Embedding generation
- Vector indexing
- Semantic and similarity search
- Metadata filtering
- Hybrid retrieval
- Reranking
- Context construction
- Grounded response generation
- Optimize retrieval strategies to improve relevance, groundedness, accuracy, latency, and cost.
- Design solutions that support appropriate data access controls and enterprise security requirements.
Model Context Protocol (MCP) & Enterprise Integration- Design and implement Model Context Protocol (MCP) integrations that securely connect AI agents and LLM applications with enterprise capabilities.
- Develop patterns for exposing enterprise tools, APIs, applications, and data sources to AI agents.
- Design appropriate authentication, authorization, access control, and security boundaries for AI-driven tool execution.
- Establish reusable integration patterns for connecting AI solutions with existing enterprise platforms and services.
Python & Backend Engineering- Design and develop backend applications and services using Python and Flask or related Python frameworks.
- Build REST APIs, microservices, AI services, and integration layers supporting Generative AI applications.
- Develop robust production-quality code with appropriate testing, error handling, logging, security, and observability.
- Lead code reviews and establish development standards and reusable engineering patterns.
- Troubleshoot complex application, integration, model, and production issues.
Amazon Bedrock & AWS- Design and implement enterprise Generative AI solutions using Amazon Bedrock and related AWS services.
- Work with Bedrock Foundation Models, Knowledge Bases, Guardrails, model APIs, and associated capabilities.
- Architect secure, scalable, resilient, and highly available cloud-native AI solutions on AWS.
- Design appropriate cloud architecture for compute, storage, networking, security, integration, monitoring, and deployment.
- Optimize cloud and model infrastructure for performance, reliability, scalability, and cost.
Solution & Enterprise Architecture- Translate business requirements and use cases into scalable technical solutions and architectures.
- Define:
- System components and boundaries
- Application and service interactions
- Integration patterns
- Data flows
- AI/LLM architecture
- Security controls
- Deployment architecture
- Technology selections
- Partner closely with the Enterprise Architect on new solutions and enhancements to existing enterprise architecture.
- Develop architecture diagrams, technical designs, decision records, and implementation guidance.
- Communicate architecture decisions and technical tradeoffs effectively to engineering teams, architects, product stakeholders, and leadership.
- Understand and communicate relevant industry best practices and emerging Generative AI architecture patterns.
Microservices & API Architecture- Design scalable distributed applications using microservices and API-based architectures.
- Define REST API and service integration patterns for AI-enabled applications.
- Apply appropriate resiliency patterns, including retries, timeouts, circuit breakers, asynchronous processing, and graceful failure handling.
- Incorporate event-driven architectures where appropriate.
- Ensure services are designed for scalability, security, maintainability, and observability.
AI Observability & Optimization- Establish monitoring and observability practices for production Generative AI applications.
- Troubleshoot issues across prompts, models, retrieval pipelines, agent workflows, integrations, APIs, and infrastructure.
- Analyze and optimize:
- Model performance
- Prompt effectiveness
- Retrieval quality
- Token utilization
- Application latency
- Reliability
- Scalability
- Infrastructure and inference costs
- Define operational metrics and dashboards that provide visibility into the health and effectiveness of AI applications.
Enterprise AI Engineering & Responsible AI- Ensure Generative AI solutions meet enterprise requirements for:
- Security
- Data privacy
- Access control
- Governance
- Responsible AI
- Monitoring and auditing
- Production readiness
- Design appropriate guardrails and controls for enterprise AI applications.
- Partner with architecture, security, platform, and governance teams to ensure solutions comply with organizational standards.
- Identify and mitigate risks associated with model behavior, sensitive data exposure, prompt injection, unauthorized tool execution, and other emerging AI security concerns.
Technical & Team Leadership- Provide formal leadership for a team of approximately 3-5 engineers.
- Lead technical planning, work decomposition, estimation, task assignment, and execution.
- Provide hands-on technical direction and unblock engineers when complex issues arise.
- Mentor engineers and develop their Generative AI, cloud, architecture, and software engineering capabilities.
- Conduct design and code reviews and ensure engineering deliverables meet established quality standards.
- Establish engineering standards, reference architectures, reusable patterns, and development practices.
- Balance delivery responsibilities with longer-term architectural quality and technical sustainability.
AI-Accelerated Software Development- Champion the responsible use of AI across the Software Development Life Cycle (SDLC).
- Identify opportunities to apply AI to accelerate:
- Requirements analysis
- Solution design
- Software development
- Code reviews
- Unit and integration testing
- Documentation
- Troubleshooting
- Refactoring
- DevOps and operational activities
- Develop and promote effective AI-assisted engineering practices while maintaining appropriate human review, security, and quality controls.
- Measure and communicate improvements in engineering productivity and software quality resulting from AI adoption.
Requirements- 8+ years of experience in software engineering, cloud engineering, solution architecture, AI/ML engineering, or related technical roles.
- Significant hands-on software engineering experience using Python.
- Strong experience designing and building backend services, REST APIs, microservices, and enterprise integrations using Flask or comparable Python frameworks.
- Strong hands-on experience designing and developing Generative AI and LLM applications.
- Demonstrated experience building agentic AI solutions, including tool/function calling, orchestration, state management, memory, and human-in-the-loop workflows.
- Hands-on experience with LangChain and LangGraph, including stateful agent workflows.
- Strong experience designing and implementing production-grade RAG solutions.
- Strong understanding of embeddings, semantic search, similarity search, vector databases, metadata filtering, reranking, and hybrid retrieval.
- Experience implementing or integrating MCP-based solutions or comparable patterns for connecting AI agents to enterprise tools and systems.
- Hands-on experience with Amazon Bedrock and AWS-based Generative AI solutions.
- Strong AWS cloud architecture experience, including designing secure, scalable, resilient, and highly available solutions.
- Strong understanding of distributed systems, microservices, APIs, and enterprise integration patterns.
- Experience defining and implementing LLM/RAG evaluation frameworks.
- Experience troubleshooting and optimizing Generative AI applications across model behavior, retrieval, prompts, latency, reliability, token utilization, and cost.
- Strong understanding of enterprise AI security, governance, privacy, responsible AI, and production operationalization.
- Demonstrated ability to translate business requirements into end-to-end solution architectures and technical implementation plans.
- Experience formally leading or providing technical leadership to engineering teams.
- Ability and willingness to remain hands-on with architecture, design, coding, prototyping, troubleshooting, and delivery.
- Excellent communication skills with the ability to explain complex AI and architecture concepts to both technical and non-technical audiences.
- Ability to understand, evaluate, and communicate emerging industry trends and best practices in Generative AI.
Preferred Qualifications- Experience leading teams of 3-5 software, cloud, or AI engineers.
- Experience building and operating enterprise Generative AI applications in production.
- Experience implementing multi-agent systems and complex LangGraph workflows.
- Experience developing MCP servers, MCP clients, or enterprise MCP integration patterns.
- Experience with multiple commercial and open-source foundation models and the ability to evaluate model tradeoffs based on use case, performance, security, latency, and cost.
- Experience with vector database technologies and enterprise search platforms.
- Experience with AWS serverless and container technologies, such as Lambda, ECS, EKS, API Gateway, and related services.
- Experience with Infrastructure as Code, CI/CD, automated testing, and DevSecOps practices.
- Experience implementing AI observability, tracing, evaluation, and monitoring platforms.
- Understanding of emerging AI security risks, including prompt injection, data leakage, insecure tool execution, excessive agency, and model misuse.
- Experience establishing reusable enterprise AI platforms, reference architectures, or engineering frameworks.
- Expe