Location: Anywhere in Country
The opportunityWe're hiring an experienced agent AI Software Architect that is an expert in designing and implementing AI memory architectures and data fabric for complex enterprise use cases. This role is for a software AI professional who has leveraged advance memory architectures, context design, data fabrics for AI, multi-agent memory communication systems. You should be familiar with short term/long term, episodic, semantic, associative and advanced structural memory design patterns. Both dedicated, shared and federated memory architectures. Familiar with algorithmic approaches to selective retention and decay strategies. RAG, skills and other context setting capabilities using advance semantic chunking and search capabilities. Understanding of inference optimization including distributed inference for prefill and decode, pipelining architectures/batching of inference. The successful candidate is someone who has experience in enterprise multiagent design patterns. Understanding of AI pre/post training, fine tuning/customization and model synthesis a plus. The candidate should thrive in fast-paced environments and are passionate about enabling scalable AI solutions.
Your key responsibilities- Design memory architectures for multi-agent systems to be replicated across AI native designed systems.
- Design of context systems including RAG and Skills with semantic chunking and search.
- Implement and test these architectures benchmarking performance against agent and human designed evals.
- Design replicable integration frameworks for use of memory architecture across multiple systems.
- Drive agent design requirements and implement through AI Native design process..
- Assess through primary and secondary research emerging memory architectures and frontier model proposals.
- Collaborate with other architectural experts in AI, Security, Data and Infrastructure to insure balanced and practical outcomes.
- Support strategic business development activities for emerging technology as required.
- Present at academic conferences and support development of IP filings
- Hands on coding and mentoring other members of the Knowledge / Data team
Skills and attributes for success- Strong analytical and troubleshooting skills.
- Ability to lead software architectural product functions and mentor junior engineers.
- Comfort working across cross-functional teams and managing competing priorities.
- Build and manage strong internal and external partnerships by fostering trust, empathy, and mutual value.
- Leverage emotional agility and hybrid collaboration to navigate diverse stakeholder needs and drive long-term engagement.
- Use critical thinking and creative reasoning to address complex problems and exceed expectations.
- Align cross-functional teams around shared goals, ensuring accountability and progress. Use emotional intelligence and hybrid collaboration to motivate others and deliver high-impact results.
To qualify you must have- Advanced degree in Electrical Engineering, Computer Science or Mathematics.
- 5+ years of experience in software engineering and AI.
- Experience working with AI Frontier models and memory / context architectures
- Use of AI native software development tools / code assist (Cursor, Claude Code, Qodo/Codium, Gemini, AWS Q, GitHub)
- Familiarity with scripting languages (Python, Bash etc....) and software languages (Go, Rust, Java etc...).
- Understand AI Native design process and principles
- Deep understanding of model fine tuning and customization through context management (RAG, SFT, LoRA/PEFT etc...)
- Experience with modern software IDE, CI/CD pipeline, modern code hosting and collaboration (Github/Gitlab/Azure DevOps etc...)
- Experience with Nvidia NVAIE and MSFT Azure AI stacks.
Ideally, you'll also have- Experience with large-scale cross functional software development projects.
- Excellent communication and leadership abilities.
What we offer youAt EY, we'll develop you with future-focused skills and equip you with world-class experiences. We'll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more.
- We offer a comprehensive compensation and benefits package where you'll be rewarded based on your performance and recognized for the value you bring to the business. The base salary range for this job in all geographic locations in the US is $125,500 to $230,200. The base salary range for New York City Metro Area, Washington State and California (excluding Sacramento) is $150,700 to $261,600. Individual salaries within those ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options.
- Join us in our team-led and leader-enabled hybrid model. Our expectation is for most people in external, client serving roles to work together in person 40-60% of the time over the course of an engagement, project or year.
- Under our flexible vacation policy, you'll decide how much vacation time you need based on your own personal circumstances. You'll also be granted time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.
Are you ready to shape your future with confidence? Apply today. EY accepts applications for this position on an on-going basis.
For those living in California, please click here for additional information.
EY focuses on high-ethical standards and integrity among its employees and expects all candidates to demonstrate these qualities.