Senior AI Software Engineer

CGI

$102K — $137K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8+ years of software engineering experience, including 2+ years developing production-grade AI/LLM applications.
  • Experience creating enterprise B2B SaaS products with embedded AI functionalities.
  • Hands-on experience with multi-agent orchestration frameworks like LangGraph or CrewAI.
  • Strong design experience with Retrieval-Augmented Generation (RAG) and vector database solutions.
  • Advanced proficiency in Python, particularly with FastAPI.
  • Familiarity with integrating LLM applications with enterprise data sources and workflows.
  • Excellent analytical and communication skills for conveying complex technical concepts.

Responsibilities

  • Design and develop AI capabilities for enterprise products, including intelligent workflows and reasoning systems.
  • Create production-grade AI applications utilizing LLMs, RAG, and semantic search.
  • Implement multi-agent orchestration solutions using advanced frameworks.
  • Build AI functions for document intelligence, knowledge retrieval, and decision support.
  • Optimize data extraction and indexing processes for enhanced performance.
  • Integrate AI and LLM services with existing enterprise APIs and workflows.
  • Evaluate and improve AI model performance with testing and monitoring.

Benefits

  • Competitive compensation from the first day of employment.
  • Comprehensive health insurance options.
  • 401(k) plan with matching contributions and a share purchase plan.
  • Generous paid time off for vacations, holidays, and sick days.
  • Paid parental leave support.
  • Opportunities for learning and tuition assistance.
  • Wellness programs promoting overall well-being.
Full Job Description
Senior AI Software Engineer

Category: Software Development/ Engineering

Main location: United States, New Jersey, New Brunswick

Position ID:J0726-2558

Employment Type: Full Time

Position Description:

CGI is seeking an AI Software Engineer to join our growing AI Engineering team and help shape the future of enterprise AI solutions. At CGI, you'll work alongside industry-leading professionals to build innovative, AI-native products that solve complex business challenges for global clients. As one of the world's largest independent IT and business consulting services firms, CGI empowers our professionals to take ownership, collaborate across disciplines, and deliver meaningful outcomes through technology.

In this role, you will design and develop production-grade AI capabilities that are embedded directly into our products, not simply chatbot experiences. You will build intelligent agentic workflows, retrieval and reasoning systems, and scalable AI services that enable next-generation enterprise applications. If you're passionate about applying cutting-edge AI technologies to solve real-world problems, we'd like to meet you.

This position can be performed in the Tri-State area where CGI has an office.

Your future duties and responsibilities:

. Design and build AI capabilities embedded throughout enterprise products, including agentic workflows, retrieval systems, and reasoning engines.
. Develop production-grade AI applications using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), semantic search, and vector databases.
. Implement multi-agent orchestration using frameworks such as LangGraph, CrewAI, Semantic Kernel, or Model Context Protocol (MCP).
. Build AI capabilities including document intelligence, knowledge retrieval, planning, reasoning, and AI-assisted decision support.
. Design and optimize data extraction, classification, embedding, and indexing pipelines.
. Integrate AI and LLM services with enterprise APIs, document repositories, and business workflows.
. Evaluate and improve model performance, reliability, accuracy, and observability through monitoring, testing, and drift detection.
. Partner closely with software engineers, product managers, and architects to deliver scalable AI services through well-designed APIs.
. Document AI architecture, prompt engineering strategies, agent workflows, and evaluation methodologies while promoting engineering best practices.

Required qualifications to be successful in this role:

. Must have a minimum of 8 years of software engineering experience, including at least 2 years developing production-grade AI/LLM applications beyond proof-of-concept or notebook development.
. Experience developing enterprise B2B SaaS products with embedded AI capabilities.
. Hands-on experience with one or more multi-agent orchestration frameworks such as LangGraph, CrewAI, Semantic Kernel, or MCP.
. Strong experience designing and implementing Retrieval-Augmented Generation (RAG), vector database, and semantic search solutions.
. Advanced Python development experience, including FastAPI or similar frameworks for AI service development.
. Experience integrating LLM-based applications with enterprise data sources, APIs, and business workflows.
. Strong analytical, problem-solving, and collaboration skills with the ability to communicate technical concepts effectively.

Preferred Qualifications:
. Experience building AI-native enterprise products comparable in complexity to Harvey AI, Cursor, Notion AI, Linear, Canva, or similar platforms.
. Experience in regulated industries such as Life Sciences, Clinical Research, Healthcare, or Pharmaceuticals.
. Experience with Intelligent Document Processing (IDP) solutions such as Azure AI Document Intelligence.
. Experience deploying AI solutions on cloud platforms including Azure, AWS, or Google Cloud.
. Familiarity with MLOps, AI observability, model evaluation frameworks, and responsible AI practices.

Bachelor's degree in computer science, Engineering, or a related field, or equivalent professional experience.

Other Information:
CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications. To support the ability to reward for merit-based performance, CGI typically does not hire individuals at or near the top of the range for their role. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for this role in the U.S. is $102,000.00 $137,000.00.

CGI's benefits are offered to eligible professionals on their first day of employment to include:
. Competitive compensation
. Comprehensive insurance options
. Matching contributions through the 401(k) plan and the share purchase plan
. Paid time off for vacation, holidays, and sick time
. Paid parental leave
. Learning opportunities and tuition assistance
. Wellness and Well being programs

#LI-MP2

Skills:
  • AI Business Strat&Applications
  • GraphRAG
  • Life Sciences
  • Machine Learning
  • Python
  • FastAPI
  • LangGraph

Similar Jobs

More Jobs at CGI

More Enterprise Technology Jobs

Find similar Senior AI Software Engineer jobs: