Summary:In this role, you will lead the technical design, development, deployment, and operation of enterprise-grade AI solutions for complex, knowledge-intensive workflows. You will combine generative AI, agentic workflows, retrieval, structured and unstructured data, deterministic processing, and human expertise to create accurate, secure, explainable, and reliable production applications. You will remain hands-on with architecture and implementation while leading engineers, establishing evaluation and observability practices, and partnering with domain experts, product leaders, architects, data teams, and platform teams to translate ambiguous business challenges into scalable technical solutions.
Responsibilities:- Lead the architecture, development, deployment, and operation of enterprise-grade AI and machine learning solutions.
- Design solutions that combine large language models, agentic workflows, retrieval, structured data, APIs, and deterministic processing.
- Translate complex expert workflows into modular, testable, and maintainable software components.
- Determine where AI inference, deterministic logic, retrieval, rules, or traditional data processing will produce the most reliable outcome.
- Establish evaluation strategies using representative test sets, expert-reviewed outcomes, regression testing, quality measurements, and stage-level analysis.
- Design observability capabilities that capture intermediate outputs, decision traces, evaluation results, performance measures, and failure modes.
- Lead investigations into grounding failures, hallucinations, retrieval quality, prompt behavior, model selection, orchestration, latency, accuracy, and cost.
- Evaluate architectural tradeoffs across performance, maintainability, extensibility, security, reliability, supportability, and operating cost.
- Develop APIs, services, prototypes, and production components while contributing to design reviews, code reviews, and complex technical problem-solving.
- Implement security, privacy, auditability, monitoring, and production-readiness practices for AI-enabled applications.
- Partner with domain experts, product leaders, architects, data teams, and platform teams to convert specialized knowledge into scalable system behavior.
- Develop reusable AI capabilities, engineering patterns, evaluation frameworks, and platform components that support multiple solutions.
- Mentor engineers and strengthen team practices across AI engineering, software design, testing, observability, and production operations.
- Drive continuous improvement by incorporating production metrics, evaluation results, expert feedback, and real-world user outcomes.
Qualifications:- Relevant degree preferred.
- 7 or more years of relevant experience required.
- Experience providing technical leadership for complex, production-grade software or AI systems required.
- Demonstrated experience personally designing, building, deploying, and operating generative AI or machine learning applications in enterprise production environments required.
- Strong experience with Python and modern API and service development, including FastAPI or comparable frameworks required.
- Experience with large language models, prompt engineering, structured outputs, tool or function calling, retrieval-augmented generation, and agentic workflows required.
- Experience establishing evaluation strategies for nondeterministic AI systems, including test datasets, regression evaluation, grounding, quality measurement, and failure analysis required.
- Strong understanding of the appropriate boundaries between probabilistic AI behavior and deterministic software, rules, retrieval, and data processing required.
- Experience with cloud-native architecture, asynchronous processing, APIs, events or queues, persistence, monitoring, and production observability required.
- Experience addressing enterprise security, privacy, reliability, auditability, supportability, performance, and cost requirements required.
- Experience with Microsoft Azure, Azure AI Foundry, Azure AI Search, or comparable cloud AI and semantic-retrieval technologies preferred.
- Experience with Databricks, vector databases, embeddings, reranking, semantic search, or enterprise knowledge-retrieval platforms preferred.
- Experience developing AI solutions involving sensitive, regulated, or high-consequence data and decisions preferred.
- Strong technical leadership, mentoring, communication, problem-solving, architecture, and cross-functional collaboration skills.
Estimated Hiring Range:At Vizient, we consider skills, experience, and organizational needs in our compensation approach. Geographic factors may adjust the range estimate and hires typically fall below the top range. Compensation decisions are tailored to individual circumstances. The current salary range for this role is $117,600.00 to $206,000.00.
This position is also incentive eligible.
Vizient has a comprehensive benefits plan! Please view our benefits here:
http://www.vizientinc.com/about-us/careers
