Norfolk Southern Corporation

Lead Data Scientist (GenAI)

Norfolk Southern Corporation$120K — $150K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in computer science, data science, machine learning, NLP, AI, linguistics, or related field
  • 4-7+ years of experience in Data Science, Machine Learning, NLP or AI roles
  • Experience building, fine-tuning, and operationalizing large language models (LLMs)
  • Proficiency in Python and relevant libraries such as Scikit-learn and PyTorch
  • Skilled in SQL, NoSQL, and specific databases like Milvus and Pinecone

Responsibilities

  • Lead design and architecture of enterprise Generative AI solutions
  • Design modular, framework-agnostic LLM pipelines using tools like LangChain
  • Define prompting strategies, agent patterns, and RAG architectures for scalability
  • Oversee the lifecycle from development to deployment and production
  • Ensure responsible AI practices, including explainability and compliance
  • Evaluate emerging AI trends for high-value innovations
  • Collaborate with cross-functional teams to tailor scalable solutions

Benefits

  • Hybrid work environment with 2-3 days on-site
  • No shift work, on-call duties, or weekend commitments
Full Job Description
Requisition 39922: B4 Lead Data Scientist (GenAI)

Job Description

Who we are and what we do:

Norfolk Southern Corporation is seeking a Lead Data Scientist (GenAI) to join our enterprise AI team. This role focuses on developing, optimizing, and enhancing intelligent solutions using Generative AI technologies, including Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and Model Context Protocol (MCP) servers. The ideal candidate will partner with technical and business leaders across the enterprise to deliver scalable, secure, and high-performing AI capabilities that drive business value. The position involves working with cloud-based platforms, modern AI/ML frameworks, and collaborating across business units to solve complex problems.

What kind of problems do we solve:
Document Intelligence: Analyze and extract insights from thousands of corporate documents, reports, and operational data using advanced NLP techniques.
Conversational AI: Build intelligent chat systems that help employees retrieve information and interact with enterprise data.
GenAI Solutions: Creating and deploying Generative AI models for document processing, visual data analysis, and natural language understanding.
Model Context Protocol (MCP): Enhance AI agent capabilities through custom tool integrations and context-aware servers.

Responsibilities
• Lead design and architecture of enterprise GenAI solutions tailored to business use cases.
• Design modular, framework-agnostic LLM pipelines using libraries such as LangChain, LlamaIndex, or similar
• Define prompting strategies, agent patterns, and RAG architectures. Ensure approaches are scalable, reusable company-wide and drive adoption across teams.
• Oversee lifecycle of usecases: Development to Deployment to Production and MLops.
• Ensure responsible AI practices, including explainability, governance, and compliance.
• Evaluate emerging AI trends and help guide the adoption of high value innovations.
• Collaborate with cross-functional teams to understand business needs and deliver configurable, scalable solutions.

Education Required
• Bachelor's in computer science, data science, machine learning, NLP, AI, linguistics, or related field required.

Skills Required:
• 4-7+ years of experience in Data Science, Machine Learning, NLP or AI positions.
• Extensive background in building, finetuning and operationalizing large language models (LLMs) in production environment.
• Proficiency in Python, including libraries such as Scikit-learn, PyTorch, Pandas, NumPy, spaCy, NLTK, and Matplotlib.
• Skilled in SQL, NoSQL, Milvus, Pinecone, PGVector databases

Skills Preferred:
• Advanced degree, e.g., Ph.D. or M.S. computer science, data science, machine learning, NLP, AI, linguistics, or related field preferred.
• Highly experienced in creating Agentic LLMs and knowledge of orchestration frameworks such as LangGraph.
• NLP and AI/ML Frameworks: Experience with training NLP models from scratch, working with Large Language Models, and using libraries such as spaCy, NLTK, and Transformers.
• Highly experienced with cloud platforms, preferably AWS (ECS, S3, Lambda, Bedrock, OpenSearch), Databricks, and Datadog.
• DevOps knowledge: Docker, Kubernetes, CI/CD, Git, Terraform.

Work Conditions
Environment: Hybrid 2-3 days on-site and remote work 3-2 days per week.
Shift Work: No
On-Call: No
Weekend Work: No

#IND

About Norfolk Southern Corporation

As a leading transportation provider, Norfolk Southern operates 20,000 route miles in 22 states and D.C., supports international trade with service to every major Eastern seaport, 10 river ports, and nine lake ports, and operates the most extensive intermodal network in the East. NS' board of directors and executive management team lead one of the nation’s top transportation companies. NS invests in projects to expand the rail network, increase freight capacity, and improve efficiency for customers. These projects create jobs and reduce greenhouse gas emissions, making green shipping a reality.

Norfolk Southern Corporation Careers

Join the dynamic team at Norfolk Southern Corporation, a leader in the transportation industry, where innovation, leadership, and diversity drive us forward. As one of the most respected names in rail transportation, there has never been a better time to explore job opportunities with us. Work You’ll Do At Norfolk Southern, we are committed to transforming the future of freight transportation. Join our market-leading team to help innovate and implement solutions that contribute to the efficiency and sustainability of our operations. Our professionals are at the forefront of the industry, combining their skills in technology and logistics to enhance our services and customer satisfaction. Lead with Excellence Step into a role that places you at the intersection of industry expertise and transformative leadership. Norfolk Southern offers a unique position in the marketplace, allowing you to drive change and influence innovation within the company and the industry. Collaborate with Experts Work alongside a dedicated team of over 20,000 professionals who are committed to excellence in every aspect of transportation and logistics. At Norfolk Southern, you will find a culture that values teamwork, professional growth, and diversity training, ensuring that every team member can thrive. Norfolk Southern Corporation Employment Opportunities We are continuously building our team to master the challenges of the transportation sector and exceed the expectations of our customers and communities. Whether you are looking for a full-time position, an internship, or leadership opportunities, Norfolk Southern offers a range of career paths to suit your professional goals. Innovate and Grow Join Norfolk Southern to engage in work that matters. With a focus on innovation and technology, our team is dedicated to finding cutting-edge solutions that improve not only our operations but also the environment and communities we serve. Your career at Norfolk Southern is limited only by your ambition, with countless opportunities to advance and expand your skills. Be Part of Our Team Experience the benefits of working with a company that supports your professional and personal growth. Enjoy comprehensive benefits, inclusive culture, and opportunities for networking and career development. At Norfolk Southern, we are not just hiring employees; we are fostering future leaders. Explore Norfolk Southern Jobs Discover the various job opportunities at Norfolk Southern Corporation and find a position that matches your skills and interests. We are looking for passionate, curious, and solution-driven team players who are ready to make a significant impact. Stay Connected Join Our Team Search open positions, submit your resume, and prepare for an interview that could lead to your next big career move. Norfolk Southern is actively hiring and looking for individuals who are ready to contribute to our legacy of success. Keep Up to Date Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work here. Job Alert Emails Personalize your subscription to receive job alerts, latest news, and insider tips tailored to your preferences. Explore the exciting and rewarding opportunities that await at Norfolk Southern Corporation. Join Norfolk Southern Corporation today and be part of a team that is dedicated to transforming the future of transportation through innovation, leadership, and a commitment to diversity and professional growth.
Learn more about Norfolk Southern Corporation
Size
18,100 employees
Market Cap
$57.2 billion
Industry
Net Income
$2 billion
Founded
1980
5 Year Trend
+2.4%
Revenue
$9.7 billion
NASDAQ

Similar Jobs

More Jobs at Norfolk Southern Corporation

More Information Technology Jobs

Find similar Lead Data Scientist (GenAI) jobs: