Position Summary...Walmart's Associate Experience Platform team is seeking an exceptional Staff Software Engineer to strengthen our GenAI experience platform. You will be hands-on developing critical platform capabilities with cutting-edge GenAI technologies, building reusable and extensible platform services, and ultimately bringing GenAI to the day-to-day of 2.2M Walmart associates worldwide.
What you'll do...- Design and develop platform features enabling advanced semantic routing for GenAI-powered services, ensuring requests are intelligently directed to the most appropriate models or agents based on context and intent.
- Build and maintain evaluation pipelines for semantic router data, including the development of metrics, dashboards, and automated tests to assess routing accuracy, system performance, and user satisfaction.
- Collaborate with applied researchers and data scientists to continuously improve semantic routing algorithms and integrate the latest advancements in natural language understanding.
- Develop and implement agent-to-agent (A2A) communication protocols to enable seamless orchestration and collaboration between multiple GenAI agents and services within the platform.
- Contribute to the design and development of platform features using microservices (FastAPI) and event-driven architecture (Kafka, SSE, WebSocket)-all in Python.
- Uphold engineering and operational excellence standards, embracing automation and the DRY (Don't Repeat Yourself) principle.
- Support operational excellence for semantic routing and agent communication systems, including monitoring, troubleshooting, and participating in on-call rotations for production support.
- Stay current with GenAI and multi-agent system best practices, adopting new solutions to enhance platform intelligence, reliability, and scalability.
- Be an active member of a dynamic team, contributing to code reviews, design discussions, and collaborative problem-solving.
- Support production operations by participating in on-call rotations
What you'll bring: Essential skills - Python guru with a proven track record of writing high-performing, production-quality code.
- Hands-on experience designing and building Python-based web services in a production setting (FastAPI experience preferred).
- Deep familiarity with version control using Git in collaborative team environments.
- Comfortable working with Linux environments and containerization technologies such as Docker.
- 4+ years of industry experience with demonstrated ownership and delivery of software products.
GenAI & Semantic Routing Skills (Preferred) - Hands-on experience developing or deploying GenAI-based applications (e.g., large language models, generative AI frameworks).
- Experience working with or integrating open-source and/or commercial GenAI libraries/frameworks such as Hugging Face Transformers, LangChain, OpenAI API, or similar.
- Ability to productionize and evaluate GenAI models.
- Familiarity with prompt engineering, vector databases (e.g., Pinecone, FAISS, Weaviate), and orchestration tools for GenAI workflows.
- Experience with semantic routing, including designing systems that direct user queries or tasks to the appropriate AI agents or models based on content, intent, or context.
- Ability to analyze, test, and improve semantic routing algorithms and evaluate their effectiveness using data-driven approaches.
- Awareness of responsible AI principles, including model evaluation, bias mitigation, and production monitoring.
Supplemental skills - Experience developing large-scale data pipelines in contexts such as e-commerce, recommender systems, or similar domains.
- Exposure to MLOps practices and tools (e.g., MLflow, Kubeflow, Airflow) for managing model lifecycle and deployment.
- Experience with observability and monitoring tools for production AI systems.
Minimum Qualifications...Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.
Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 4 years' experience in software engineering or related area.
Option 2: 6 years' experience in software engineering or related area.
Preferred Qualifications...Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.
Master's degree in Computer Science, Computer Engineering, Computer Information Systems, Software Engineering, or related area and 2 years' experience in software engineering or related area, We value candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly. The ideal candidate would have knowledge of accessibility best practices and join us as we continue to create accessible products and services following Walmart's accessibility standards and guidelines for supporting an inclusive culture.
Primary Location...508 Sw 8Th St, Bentonville, AR 72712, United States of America
Walmart and its subsidiaries are committed to maintaining a drug-free workplace and has a no tolerance policy regarding the use of illegal drugs and alcohol on the job. This policy applies to all employees and aims to create a safe and productive work environment.
