Cisco

AI LLMOps Engineering Technical Leader

Cisco$216K — $280K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree and 8+ years of related experience, or Master's and 6+ years.
  • Experience in Software Engineering and DevOps with a focus on scalable infrastructure.
  • Operational experience with Large Language Models (LLMs) like OpenAI or Anthropic.
  • Proficiency in Python and/or Java/J2EE.
  • Experience developing APIs using frameworks like FastAPI or Spring Boot.
  • Knowledge of CI/CD for machine learning and MLOps frameworks like MLflow or Docker.

Responsibilities

  • Drive operationalization of agent architectures into secure, scalable production environments.
  • Define and establish robust MLOps practices and foundational ML pipelines.
  • Design telemetry tools to monitor token usage and compute costs.
  • Proactively resolve infrastructure challenges managing containerized models on GPU clusters.
  • Guide architectural choices based on market knowledge while mentoring peers.

Benefits

  • Work within a cutting-edge AI team focused on customer reliability.
  • Collaborate with MLOps experts, reliability engineers, and software developers.
  • Opportunities to shape reliability in a rapidly evolving AI landscape.
  • Directly impact customer experience through complex challenges in AI technologies.
Full Job Description
The application window is expected to close on: 10/30/2026
Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received.

Meet the Team

The team operates at the cutting edge of AI, functioning within the broader Customer Experience Engineering organization as a specialized Customer Reliability Engineering (XRE) group to support Cisco's customer experience (CX) platform. Our primary mission is to ensure seamless, highly reliable production systems by fiercely resolving complex customer reliability issues, managing critical escalations, and ensuring AI-driven solutions are secure and performant. We are a collaborative, agile group of MLOps experts, reliability engineers, and software developers who thrive on troubleshooting and stabilizing complex technical ecosystems. Working closely with design, data science, and product management, our efforts directly protect Cisco's CX product roadmap and ensure long-term customer success. What's most exciting is the opportunity to shape the reliability of a rapidly evolving AI landscape, directly impacting the customer experience by tackling complex challenges in hybrid cloud environments, LLM orchestration, and inference optimization every day.

Your Impact

As an AI Operations Engineering Technical Leader focusing on Agentic AI and MLOps, you will drive the operationalization of complex autonomous agent architectures into secure, scalable, and high-performing production environments. Define and establish robust MLOps practices, foundational ML pipelines, and model serving architectures to bring innovative Agentic AI concepts out of the lab and into customer-facing products. Design and implement robust telemetry monitoring tools to track token usage, control compute costs, monitor agent reasoning paths, and ensure optimal model performance and security. Proactively resolve complex infrastructure challenges by managing containerized models on GPU clusters and addressing model inference issues. Guide architectural choices based on deep market knowledge and mentor peers, ensuring our Agentic AI platforms remain reliable, scalable, and ahead of the curve.

Minimum Qualifications
  • Bachelors degree and 8+ years of related experience, or Masters and 6+ years of related experience.
  • Experience within Software Engineering and DevOps job families, specifically focusing on building scalable infrastructure.
  • Experience operationalizing Large Language Models such as OpenAI, Anthropic, Llama or similar and utilizing LLM frameworks such as LangChain or LangSmith.
  • Experience in Python and/or Java/J2EE.
  • Experience developing robust APIs using popular frameworks such as FastAPI, Flask, Spring Boot or similar.
  • Experience with CI/CD concepts for machine learning and familiarity with model tracking and MLOps frameworks such as ClearML, MLflow, Weights & Biases or similar and containerization utilizing Docker and Kubernetes.


Preferred Qualifications
  • Expertise in Agentic AI with hands-on experience in AI Agent development, including designing, orchestrating, and deploying autonomous systems and multi-agent workflows.
  • Broad perspective and ability to articulate architectural design choices regarding GPU compute scaling, model latency, and AI routing, including knowledge of AI API gateways and proxying solutions like Apache APISIX or LiteLLM.
  • Strong verbal and written communication skills to effectively negotiate delivery trade-offs (e.g., latency vs. model accuracy vs. cost) with cross-functional partners.
  • Experience contributing to threat modeling, specifically identifying and mitigating risks regarding prompt injection or AI data leakage.
  • Proven leadership ability to facilitate knowledge-sharing sessions, lead postmortems, and mentor junior team members on technical designs.


About Cisco

Cisco Careers

Join the vibrant team at Cisco, a global leader in networking and cybersecurity solutions, where innovation and leadership thrive. Cisco offers a plethora of job opportunities that cater to a range of skills and experiences, making it an ideal place for both seasoned professionals and those seeking an internship to jumpstart their career. Work You’ll Do At Cisco, you’ll be part of a culture that values diversity, leadership, and professional growth. Engage in work that matters with a team that combines technology, creativity, and the power of human connection to redefine networking. Cisco’s commitment to innovation isn’t just about technology, but also about transforming the way we work and collaborate. Cisco’s employment philosophy supports career advancement and nurtures a leadership pipeline that is equipped with diversity training and opportunities for growth. Whether you’re applying your skills to drive our latest innovations or using our vast networking capabilities to solve complex problems, at Cisco, every role is impactful. Join Our Dynamic Team Explore job opportunities in areas ranging from engineering to marketing, sales to cybersecurity. Cisco is hiring individuals who are passionate, curious, and ready to drive change. Positions at Cisco offer competitive benefits, a supportive culture, and the chance to work with cutting-edge technology. Internship Programs Kickstart your career with a Cisco internship. Gain invaluable industry experience, enhance your resume, and build professional networks that last a lifetime. Our internships provide hands-on experience and the chance to work on projects that matter. Leadership and Development Cisco is committed to fostering leadership skills and providing employees with the training needed to succeed. Our leadership programs help you develop new skills, manage teams effectively, and lead with confidence. Cisco’s commitment to professional development ensures that your career path is as dynamic as our technologies. Benefits and Culture Cisco understands the importance of a balanced life. Our benefits package is designed to ensure that our team members are healthy, happy, and secure. At Cisco, you’ll find a supportive culture that encourages open communication, teamwork, and mutual respect. Stay Connected Join Cisco’s Talent Network Stay informed about new positions that match your skills and interests. At Cisco, we value the curiosity and unique perspectives of our team members. Subscribe to receive personalized job alerts and insider tips directly from our hiring managers. Explore Cisco Jobs Ready to advance your career at Cisco? Search open positions, prepare your resume, and get ready for an interview that could lead to your next big opportunity. At Cisco, we’re not just filling positions—we’re investing in leaders. Keep Up to Date Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work here. READ CAREERS BLOG Job Alert Emails Customize your subscription to receive job alerts, the latest news, and insider tips tailored to your preferences. Discover the exciting and rewarding career opportunities that await you at Cisco.
Learn more about Cisco
Size
79,500 employees
Market Cap
$194.5 billion
Industry
Net Income
$10.1 billion
Founded
2014
5 Year Trend
+1.4%
Revenue
$48 billion
NASDAQ

Similar Jobs

More Jobs at Cisco

More Information Technology Jobs

  • Program Manager – M&A Integration
    $100K — $200K *
    Bee Talent Solutions
    San Francisco, CA 94105 (San Francisco County)
  • Incident Response Lead
    $150K — $180K *
    Antietam Technologies Inc.
    Germantown, MD 20874 (Montgomery County)
  • Senior SailPoint SME
    $120K — $145K *
    Calista Brice Holding Company
    Washington, DC 20011 (District Of Columbia County)
  • Project Manager
    $110K — $130K *
    Calista Brice Holding Company
    Washington, DC 20011 (District Of Columbia County)
  • Tier 2 Helpdesk Lead
    $80K — $95K *
    Calista Brice Holding Company
    Washington, DC 20011 (District Of Columbia County)

Find similar AI LLMOps Engineering Technical Leader jobs: