What You'll Do As a Staff AI Engineer, you will be a senior technical leader responsible for designing, evolving, and scaling Teradata's enterprise AI platforms and capabilities. This role goes beyond feature delivery-you will own architecture level decisions, influence AI platform strategy, and lead complex initiatives spanning agentic AI, LLM platforms, retrieval augmented generation (RAG), vector stores, and developer facing AI systems.
You will operate with a high degree of autonomy, partner closely with product and architecture leadership, and raise the technical bar across multiple teams.
Key Responsibilities
Technical Leadership & Architecture
- Lead the design and evolution of largescale, distributed AI systems that power Teradata's AI platform and AI native products.
- Own end-to-end architecture for critical AI capabilities such as agentic workflows, RAG pipelines, vector search, semantic retrieval, and AI orchestration frameworks.
- Drive technical strategy and architectural consistency across multiple engineering teams.
AI Systems & Platform Development
- Design and implement production grade AI systems using LLMs, embeddings, vector databases, and agent based architectures.
- Build scalable, secure, and reusable platform services and APIs supporting AI workloads across the software development lifecycle.
- Define and implement guardrails for reliability, safety, governance, and cost control in enterprise AI systems.
Cross Functional Influence
- Partner with product management, architecture, research, and cloud platform teams to translate business requirements into scalable AI solutions.
- Influence roadmap decisions by providing deep technical insight, tradeoff analysis, and long-term platform thinking.
- Act as a technical escalation point for complex system design, performance, and reliability challenges.
Quality, Performance & Operational Excellence
- Drive best practices for testing, observability, evaluation, and production readiness of AI systems.
- Identify systemic performance bottlenecks and lead efforts to optimize distributed systems and AI pipelines.
- Establish engineering standards that improve development velocity, quality, and operational resilience.
Mentorship & Org Level Impact
- Mentor Senior and Staff level engineers, providing guidance on architecture, design reviews, and technical decision making.
- Raise the overall engineering bar through design forums, technical reviews, and knowledge sharing.
- Lead by example through hands on contributions to the most complex and business critical problems.
Who You'll Work With You will partner closely with product and architecture leadership, and raise the technical bar across multiple teams.
What Makes You a Qualified Candidate - Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
- 8+ years of experience building backend services, distributed systems, or data/AI platforms.
- Strong proficiency in Java, Go, or Python, with experience building largescale services.
- Deep understanding of distributed system design, scalability, fault tolerance, and cloud native architectures.
- Proven experience designing and operating production systems with SQL and NoSQL data stores.
What You'll Bring - Experience with LLMs, embeddings, vector databases, and AI orchestration frameworks.
- Exposure to agentic AI patterns such as tool calling, planning, memory, and multi-step reasoning.
- Experience building or operating AI systems in cloud environments (AWS, Azure, or GCP).
- Familiarity with Kubernetes, Docker, CI/CD pipelines, and production-grade observability.
#LI-SK1
US Pay Rate: $169,400.00 - $211,700.00 - $254,100.00 Annually
Starting pay for the successful applicant will depend on geographic location, internal equity, job-related knowledge, skills, and candidate experience. Sales roles will be eligible for commission payments tied to quota achievement. All other permanent roles will be eligible for one of our annual incentive plans, which are based on company financial attainment and individual performance. Employees in this position are eligible to participate in the Company's benefits programs, which generally include health care, life and disability insurance, retirement savings, and time-off programs. Benefit details vary by country and plan, including eligibility and available options, and will be shared during the hiring process. Additional information is available here: https://www.teradata.com/About-Us/Careers/BenefitsEmployees in this position are also eligible to participate in the Company's comprehensive benefits programs, which include healthcare, life and disability insurance plans, a 401(k)-retirement savings plan, and time-off programs. Specific details of these benefits, including eligibility criteria and plan options, will be provided during the hiring process and can be reviewed here: https://www.teradata.com/About-Us/Careers/Benefits
