Lead AI Software Engineer

Compunnel

• $150K — $180K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree with 10+ years or Master's degree with 8+ years in software engineering.
  • 8+ years of software engineering experience, including senior or lead roles.
  • 2+ years of technical leadership experience mentoring engineers and guiding teams.
  • Strong skills in Java development, backend systems, API development, and microservices.
  • Proficient in distributed systems design and software architecture, cloud-native applications, and enterprise software platforms.
  • Hands-on experience with AWS, Docker, Kubernetes, and CI/CD practices.
  • Experience integrating Large Language Models (LLMs) and AI agents into production applications.

Responsibilities

  • Design and implement large-scale AI platforms and cloud-native applications.
  • Build and manage multi-agent AI workflows and production agents.
  • Integrate LLMs into production applications effectively.
  • Design architectures using Retrieval-Augmented Generation and vector databases.
  • Lead architecture discussions and establish engineering standards across teams.
  • Mentor engineers while guiding technical decision-making and best practices.
  • Collaborate with teams to drive technical strategy and governance.

Benefits

  • Opportunities for professional development and mentorship.
  • Collaborative work environment across multiple engineering teams.
  • Involvement in cutting-edge AI and software engineering initiatives.
  • Participation in Scrum ceremonies and technical discussions.
  • Focus on responsible AI practices and secure software development.
Full Job Description
div:has([data-free-thinking-preview-answer=true])+:is(.text-message,.relative:has(>.text-message))]:-mt-2 grow">

Job Summary
The Lead AI Software Engineer will provide senior technical leadership in designing, building, and scaling enterprise AI solutions. This role combines software architecture and backend engineering with modern AI technologies, including Large Language Models (LLMs), AI agents, Retrieval-Augmented Generation (RAG), vector databases, semantic search, and AI-assisted software development. The role will help establish AI engineering standards, guide technical strategy, and deliver production-grade AI solutions across multiple engineering teams.

Key Responsibilities
• Design and implement enterprise-scale AI platforms and cloud-native applications.
• Build and orchestrate multi-agent AI workflows and production AI agents.
• Integrate LLMs such as OpenAI GPT, Anthropic Claude, and Google Gemini into production applications.
• Design AI-native architectures using RAG, vector databases, semantic search, and relational databases.
• Lead architecture discussions, technical evaluations, architecture reviews, and engineering standards across multiple teams.
• Establish governance, development standards, and best practices for AI and software engineering.
• Mentor engineers and technical leads while providing technical guidance and supporting architectural decision-making.
• Participate in Scrum ceremonies, technical discussions, code reviews, and pull request reviews.
• Introduce AI coding assistants and developer AI tools into software development workflows to improve engineering productivity.
• Evaluate emerging AI technologies, frameworks, and engineering practices for enterprise adoption.
• Review existing systems, identify performance and scalability improvements, and drive platform modernization initiatives.
• Identify and reduce technical debt while improving reliability, scalability, and maintainability.
• Drive secure software development practices, AI governance, risk management, and responsible AI implementation.
• Collaborate across engineering teams to influence technical strategy and organizational engineering direction.

Required Qualifications
• Bachelor's degree with 10+ years of software engineering experience or Master's degree with 8+ years of software engineering experience.
• 8+ years of software engineering experience, including experience in senior or lead-level roles.
• 2+ years of technical leadership experience with responsibility for mentoring engineers, guiding technical teams, and influencing engineering direction.
• Strong experience with Java development, backend systems, API development, and microservices architecture.
• Strong understanding of distributed systems design and software architecture.
• Experience designing and developing cloud-native applications and enterprise-scale software platforms.
• Hands-on experience with AWS and cloud-native deployments.
• Experience with Docker, Kubernetes, and CI/CD.
• Experience integrating Large Language Models (LLMs) into production applications.
• Experience developing or implementing AI agents, agent orchestration, prompt engineering, and agentic software development or product development lifecycle patterns.
• Experience with Generative AI technologies and enterprise AI solutions.
• Experience with AI-assisted software development tools and developer productivity solutions.
• Experience with application security, cloud security, secure software development, AI governance, and risk management.
• Experience leading large-scale engineering initiatives and influencing multiple engineering teams.
• Experience establishing engineering standards, governance, and technical best practices.

Preferred Qualifications
• Experience building AI agents for production environments.
• Hands-on experience with LangChain, LangGraph, AutoGen, or CrewAI.
• Experience designing and implementing RAG architectures and semantic search solutions.
• Experience with vector databases such as Pinecone, Milvus, Chroma, or pgvector.
• Experience with Model Context Protocol (MCP) and MCP implementations.
• Experience with AI coding assistants and developer tools such as Cursor, Claude Code, or Windsurf.
• Experience with AI-enhanced engineering workflows and agentic development practices.
• Formal architecture leadership experience within large enterprise environments.

Similar Jobs

More Jobs at Compunnel

More Enterprise Technology Jobs

Find similar Lead AI Software Engineer jobs: