Senior Manager of Data Science

Compunnel

$150K — $180K *
Legal & Accounting
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 3+ years of people management experience in LLM-based applications, preferably in legal or compliance sectors.
  • Experience with LangChain and LLM agent frameworks, including deployment of RAG systems.
  • Demonstrated success in scaling LLM applications from prototype to production.
  • Proficiency in Python and LLM tooling, with knowledge of prompt tuning techniques.
  • Familiarity with vector databases and hybrid retrieval architectures, such as Solr and Elasticsearch.
  • Knowledge of Docker, Kubernetes, and CI/CD practices in a cloud environment.
  • Strong communication, collaboration, and problem-solving abilities.

Responsibilities

  • Define the strategic roadmap for integrating LLMs in legal workflows.
  • Drive AI-centric transformation across legal product platforms.
  • Translate generative AI advancements into customer value for legal applications.
  • Design systems that utilize foundation models with RAG for document creation.
  • Guide AI agents in performing complex legal reasoning and evidence citation.
  • Assess model performance within the constraints of legal standards.
  • Mentor a multidisciplinary team of Data Scientists and ML Engineers.

Benefits

  • Opportunities for professional growth and team mentoring.
  • Engagement with cutting-edge AI technologies in legal contexts.
  • Collaboration with cross-functional teams, enhancing diverse interactions.
  • Involvement in developing responsible use practices for generative AI.
Full Job Description
Job Summary We are seeking a Senior Manager of Data Science to lead a high-impact team focused on building intelligent systems powered by LLMs and RAG architectures. This role centers on delivering AI agents that generate legal documents, interpret contracts, and autonomously execute multi-step tasks across complex legal workflows. The role will drive strategy, technical execution, and team growth to build next-generation legal assistants capable of grounded reasoning, contextual document drafting, and interaction with structured and unstructured data sources. Key Responsibilities • Define the roadmap for applying LLMs and agentic AI to real-world legal drafting, summarization, and task automation challenges. • Evangelize and embed AI-driven change across legal product platforms. • Translate evolving generative AI capabilities into tangible customer value within the legal domain. • Architect systems that combine foundation models with RAG pipelines to draft contracts, memos, and pleadings grounded in enterprise knowledge. • Guide the development of AI agents that perform multi-step reasoning, cite evidence, retrieve domain-specific content, and produce compliant outputs. • Lead evaluation of model performance for generation, summarization, classification, and dialogue-based workflows with legal constraints in mind. • Build scalable prompt engineering frameworks and manage fine-tuning or adaptation of models to legal datasets. • Mentor and grow a multidisciplinary team of LLM-focused Data Scientists and ML Engineers. • Drive cross-functional collaboration with Legal SMEs, Data Engineers, Product Managers, and Design. • Establish best practices for evaluation, observability, and responsible use of generative AI. • Oversee development of infrastructure to support continuous delivery and monitoring of LLM systems in production environments. Required Qualifications • 3+ years of people management experience leading teams building LLM-based applications, particularly in domains requiring rigor and traceability such as legal, finance, or compliance. • Hands-on experience delivering systems using LangChain, LLM agent frameworks, vector databases, and prompt orchestration pipelines. • Strong experience deploying retrieval-augmented generation (RAG) systems for grounded and auditable responses. • Demonstrated success taking LLM-powered applications from prototype to production. • Proficiency in Python and LLM tooling, including LangChain, HuggingFace Transformers, OpenAI APIs, and prompt tuning techniques. • Familiarity with vector databases such as Solr, Elasticsearch, Qdrant, and Weaviate. • Knowledge of knowledge graphs and hybrid retrieval architectures. • Working knowledge of Docker, Kubernetes, CI/CD, and model serving tools such as TorchServe, Triton, or Ray Serve. • Experience with cloud infrastructure on AWS, Azure, or GCP. • Strong leadership, communication, collaboration, and problem-solving skills. Preferred Qualifications • Graduate degree in Computer Science, AI, Machine Learning, or equivalent experience. • 10+ years of post-degree experience, with 4+ years in a data science or applied AI leadership role focused on NLP/LLM systems. • Prior experience in legal technology, legal AI, or document-intensive domains. • Familiarity with ethical and legal considerations when deploying generative AI in professional settings.

Similar Jobs

More Jobs at Compunnel

More Legal & Accounting Jobs

Find similar Senior Manager of Data Science jobs: