Location: This is a hybrid remote/in-office role.
About the Team:
We are seeking a
Lead AI & Data Engineer to design, build, and deploy production-grade AI solutions and data products. In this role, you will lead the development of AI-powered solutions leveraging large language models (LLMs), retrieval-augmented generation (RAG), agent orchestration, and modern data architectures to enable new AI-driven capabilities across our
Virtual Twin ecosystem.
The ideal candidate combines deep data engineering and AI-native development expertise to build scalable, secure, and reliable AI-enabled data solutions. You will drive technical architecture, data pipeline development, AI integration, and engineering best practices, translating complex business and clinical research requirements into production-ready solutions. You will work closely with product management, data science, platform engineering, and clinical experts, to deliver innovative capabilities that enable intelligent workflows and data-driven decision-making.
Responsibilities:
- Engineer scalable, automated data pipelines and AI-powered solutions using modern AI technologies, vector databases, and automation, applying CI/CD practices and tools such as Python, SQL, and Git.
- Design, develop, and deploy production-grade AI-powered solutions leveraging LLMs, RAG, and agentic workflows.
- Implement and maintain integrations via API and MCP that connect applications and agents to enterprise data, tools, and skills in line with governance, security and compliance controls.
- Implement agent orchestration and workflow patterns using frameworks such as LangGraph, LangChain, or equivalent technologies.
- Develop agent-driven metadata management solutions to maintain data catalogs, business glossaries, lineage documentation, and governance policies.
- Apply advanced skills in data architecture, data science engineering, data modeling, and data quality using modern cloud-native technologies.
- Document and communicate technical work clearly to stakeholders at all levels, both technical and non-technical.
- Collaborate effectively in Agile environments and cross-functional teams
Qualifications:
- 7+ years of experience in data engineering or data science, with a strong foundation in enterprise data architecture, including at least 2 years of hands-on experience in AI and data engineering.
- Bachelor's degree in a technical or scientific field, such as Data Engineering, Data Science, Computer Science, or similar.
- Hands-on experience developing AI-native solutions using LLMs, RAG, AI agents, and agent orchestration patterns.
- Skilled in integrating AI/ML pipelines into production-grade data infrastructure with experience in API and MCP standards and integration, including model access controls, context management, auditability, security, compliance monitoring, and lifecycle management
- Experience implementing AI governance and guardrails, including access controls, data privacy, auditability, and policy enforcement across AI services and agents
- Proficiency in Python, SQL, and modern data engineering practices, including CI/CD and Git-based development.
- Hands-on experience with tools and concepts such as Airflow, CDC, batch processing, and job scheduling.
- Strong problem-solving, communication, and collaboration skills, with the ability to troubleshoot complex issues and to translate business requirements into secure, scalable, production-ready solutions.
- Experience with healthcare or clinical trial data is not required, but interest to learn and understand how these data improves Life Sciences is paramount.
Nice to Have: - Experience with knowledge graphs, advanced vector search, and retrieval optimization techniques.
- Familiarity with clinical research data standards and formats such as CDISC SDTM and ADaM.
- Experience with AI evaluation frameworks, benchmarking, and continuous monitoring of AI solution performance.
- Experience optimizing cloud infrastructure, AI workloads, and data processing costs.
- Familiarity with semantic layers, metadata-driven architectures, and automated data cataloging.
The salary range posted below refers only to positions that will be physically based in New York City. As with all roles, Medidata sets ranges based on a number of factors including function, level, candidate expertise and experience, and geographic location. Pay ranges for candidates in locations other than New York City, may differ based on the local market data in that region.
The salary range range for this position physically based in NYC/ NJ Metro Area is $135,000-$180,000.
Base pay is one part of the Total Rewards that Medidata provides to compensate and recognize employees for their work. Most sales positions are eligible for a commission on the terms of applicable plan documents, and many of Medidata's non-sales positions are eligible for annual bonuses. Medidata believes that benefits should connect you to the support you need when it matters most and provides benefits, including medical, dental, life and disability insurance, 401(k) matching, family leave, flexible paid time off; and 10 paid holidays per year.
#LI-MM1
#LI-Hybrid
Note: Please be on the lookout for job scams. Medidata recruiters will never ask applicants for monetary compensation, credit card, or banking details.
