Job DescriptionSenior AI EngineerLocation: Atlanta, GA | Austin, TX | Boston, MA | Charlotte, NC | Chicago, IL | Dallas, TX | Houston, TX | Los Angeles, CA | Miami, FL | New York, NY | Ashburn, VA | Phoenix, AZ | Portland, OR | San Francisco Bay Area, CA | Seattle, WA | Remote, US
Your RoleAs a Senior AI Engineer on Digital Realty's AI[redacted] team within the Office of the Chief Data Officer, you will design, build, and operate secure, production-grade AI solutions that help teams find information, access governed enterprise data, and make better decisions.
This is a hands-on technical leadership role combining AI architecture, backend engineering, cloud delivery, and stakeholder partnership. You will build solutions ranging from grounded conversational assistants and retrieval-augmented generation applications to natural-language-to-SQL and tool-using agents. You will also establish the engineering standards and architectural patterns used across the AI platform.
What You'll Do- Translate complex business needs into secure, scalable AI architectures, including retrieval-augmented generation, natural-language-to-SQL agents, tool-using agents, and conversational assistants.
- Build and operate production Python services using technologies such as FastAPI, asynchronous APIs, streaming responses, authentication, rate limiting, typed code, and automated testing.
- Design advanced retrieval pipelines using chunking, embeddings, hybrid search, semantic reranking, query decomposition, intent routing, entity resolution, and inline citations.
- Connect AI services to governed enterprise data, including Microsoft Fabric semantic models, lakehouse and warehouse sources, PostgreSQL, GraphQL services, and master data platforms.
- Lead architectural decisions, document technical trade-offs through architecture decision records, and guide solutions through security and architecture reviews.
- Oversee the production delivery of enterprise AI capabilities, including the LLM gateway, CI/CD pipelines, environment configuration, rollback planning, release validation, and platform reconciliation.
- Partner with business stakeholders, data owners, Legal, Compliance, Security, and engineering teams to define use cases, data access requirements, delivery scope, risks, and release expectations.
- Strengthen application security by addressing identity, network exposure, secrets management, least-privilege access, WAF posture, dependency risks, and cloud-security findings.
- Implement observability using OpenTelemetry, Azure Monitor, and Application Insights to measure performance, latency, cost, reliability, and AI response quality.
- Mentor engineers, review code and technical designs, maintain architecture documentation, and establish engineering standards across the AI[redacted] platform.
What You'll Need- Seven or more years of software engineering experience, including at least two years building and running LLM or generative AI applications in production.
- Advanced Python engineering skills, including asynchronous web services, FastAPI or a similar framework, typed code, automated testing, and production API development.
- Hands-on experience designing retrieval-augmented generation solutions using chunking, embeddings, hybrid retrieval, semantic ranking, reranking, and source citations.
- Experience building AI agents that call tools, interact with APIs, or generate controlled queries against structured enterprise data.
- Production cloud experience, preferably with Microsoft Azure, including containers, managed identities, networking, API management, and CI/CD pipelines.
- Demonstrated experience leading technical design, documenting architecture decisions, and presenting solutions through formal architecture or security reviews.
- Working knowledge of SQL, enterprise data platforms, data contracts, and integration patterns, with experience partnering with data engineering teams.
- Ability to translate business requirements into well-scoped technical deliverables and explain AI capabilities, limitations, risks, and trade-offs to non-technical leaders.
- Experience mentoring engineers, reviewing code and designs, and establishing standards for security, quality, testing, and production readiness.
- Bachelor's degree in computer science or a related discipline, or equivalent professional experience.
Experience with Microsoft Fabric, Azure AI Search, Azure OpenAI, Semantic Kernel, Copilot Studio, AI governance, OpenTelemetry, application-security testing, or enterprise data center environments would be an advantage.
Compensation range: $160,000-$190,000 annually. This compensation range represents the company's good-faith belief as to what it will pay as a base salary for this position at the time of posting.
Benefits: For this role, benefits include medical, dental, vision, life and AD&D insurance, 401(k) match, disability benefits, wellness and education benefits, an employee stock purchase plan, paid time off, holidays, and more.