HERE Technologies

AV Simulation Domain Expert (Sr. Principal) - US (Remote) or Chicago, IL

HERE Technologies$130K — $180K *
Transportation
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years in AV simulation, perception ML, or robotics simulation, with experience in both platforms and model development.
  • Hands-on experience with simulation platforms like CARLA or NVIDIA Drive Sim.
  • Ability to programmatically author scenarios using OpenDRIVE and OpenSCENARIO.
  • Deep knowledge of AV testing workflows and scenario-based validation methods.
  • Experience evaluating synthetic data for ML training, focusing on distribution diversity and practical utility.

Responsibilities

  • Lead the direction for integrating map data into generative world models for driving scenarios.
  • Train and adapt generative models for driving scenario creation, focusing on domain adaptation and structured input conditioning.
  • Evaluate state-of-the-art foundation models to determine their fit for autonomous vehicle training data generation.
  • Manage the complete ML lifecycle from data collection to production-grade model deployment.
  • Design proof-of-concept projects showcasing synthetic scenario generation with partners.
  • Establish success criteria focusing on data utility and sim-to-real effectiveness.
  • Bridge generative models with classical simulation systems for enhanced scenario creation.

Benefits

  • Collaborative work environment with access to cutting-edge AI technology.
  • Opportunities for professional growth and skill enhancement in a niche field.
  • Engagement in innovative projects that are shaping the future of autonomous driving.
  • Flexibility in work arrangements to promote a healthy work-life balance.
Full Job Description
What's the role?

HERE Technologies sits at a unique intersection: we own some of the world's most detailed map and drive data, and we are building the generative AI capabilities to turn that spatial intelligence into controllable, high-quality synthetic driving worlds. 

We are looking for a rare hybrid profile — someone who combines deep learning expertise in world foundation models, generative video, and transformers with hands-on AV simulation experience. You understand both how to train and adapt large generative models (think Cosmos, Cosmos-Transfer, diffusion-based video models, latent world models) and how to ground them in map data and scenario semantics so the output is actually useful for training and validating perception and planning stacks. 

This is not a pure simulation role, and it is not a pure ML research role. It is the bridge between the two — and that bridge is where HERE's differentiation lives. 

What you will do:  World Foundation Models & Generative Scenario Synthesis 

  • Drive the technical direction for map-grounded world foundation models: how we condition generative video and world models using map data, drive data, and scenario semantics. 

  • Train, fine-tune, and adapt generative models (diffusion, latent video, transformer-based world models) for driving scenario generation, including domain adaptation, controllability, and conditioning on structured inputs (maps, trajectories, agent behaviours, weather, lighting). 

  • Evaluate and extend state-of-the-art foundation models such as NVIDIA Cosmos / Cosmos-Transfer and comparable open-source world models, assessing fit for AV training data generation. 

  • Own the full ML lifecycle end-to-end: data curation, model training, evaluation, iteration, and the path to production-grade pipelines. 

 

Strategic role  

  • Lead proof-of-concept initiatives demonstrating map-grounded synthetic scenario generation with key technology partners. 

  • Define measurable success criteria that go beyond visual realism — focusing on ML training data utility, controllability, and sim-to-real transfer. 

  • Deliver POC outcomes with clear GO / PIVOT / NO-GO recommendations backed by quantitative evidence.  

Simulation, Scenario Generation & Sim-to-Real 

  • Bridge generative world models with classical simulation stacks (CARLA, NVIDIA Drive Sim, AlpaSim) where structured, physics-grounded scenarios are needed. 

  • Author and programmatically generate OpenSCENARIO / OpenDRIVE definitions that feed both classical simulators and generative pipelines. 

  • Drive sim-to-real strategy: measure domain gap, identify failure modes, and define acceptable thresholds for downstream model training. 

 

Quality Frameworks for Synthetic Training Data 

  • Define what "good enough" synthetic data means for AV perception and planning: when is photorealism required, when is label consistency sufficient, when does controllability matter most? 

  • Establish validation frameworks combining objective metrics (distribution coverage, label accuracy, FID-style measures, downstream task performance) with expert evaluation protocols. 

  • Specify sensor fidelity requirements: noise models, lens distortion, lidar return characteristics — and how generative models should or should not reproduce them. 

 

Technical Collaboration 

  • Interface with ML research teams on generative model architecture, controllability, and conditioning strategies. 

  • Collaborate with perception and planning teams to ensure synthetic data measurably improves real-world model performance. 

  • Translate business requirements into technical feasibility assessments for product and executive stakeholders. 

Who are you?

This role requires depth in both deep learning and AV simulation. We are not looking for a pure simulation engineer, and we are not looking for a generalist ML researcher without AV grounding. 

Must-Have: Deep Learning & Generative Models 

  • Proven experience training deep learning models end-to-end, with clear ownership across data, training, evaluation, and iteration. 

  • Expertise in generative video, world models, or related generative AI research/engineering. 

  • Deep working knowledge of diffusion models, latent video models, and/or transformer-based world models. 

  • Experience with high-dimensional temporal or spatio-temporal data (video, multi-sensor fusion, driving data). 

  • Strong Python and PyTorch engineering fundamentals; comfortable building research-grade tooling that can scale toward production. 

  • Demonstrated ability to take ML models from research into production, navigating real-world constraints, quality, and safety requirements. 

 

Must-Have: AV Simulation & Scenario Domain 

  • 5+ years combined experience spanning AV simulation, perception/ML for AVs, or robotics simulation — with meaningful exposure to both simulation platforms and ML model development. 

  • Hands-on experience with at least one major simulation platform: CARLA, NVIDIA Drive Sim, or equivalent. 

  • Fluency with OpenDRIVE and OpenSCENARIO: can author and generate scenario definitions programmatically and understands map format specifications. 

  • Understanding of AV testing workflows: scenario-based validation, ASAM OpenX standards, and awareness of frameworks such as ISO 34502. 

  • Understanding of what scenarios stress-test AV perception and planning systems, and why. 

 

Must-Have: Synthetic Data Quality & Sim-to-Real 

  • Ability to evaluate synthetic data for ML training utility: distribution diversity, label consistency, edge-case coverage, downstream task performance. 

  • Experience with synthetic-to-real transfer, domain adaptation, or closing the sim-to-real gap in a measurable way. 

  • Clear point of view on trade-offs between photorealism, label accuracy, controllability, and computational efficiency. 

Nice-to-Have 

  • Hands-on experience with NVIDIA Cosmos, Cosmos-Transfer, or comparable world foundation models. 

  • Reinforcement learning experience, particularly where it measurably improved real-world performance. 

  • Experience with end-to-end driving models. 

  • Automotive, OEM, or other safety-critical ML deployment experience (ISO 26262, SOTIF awareness). 

  • Strong publication record in generative models, world models, or AV ML; or significant contributions to open-source ML tooling. 

  • Game engine experience (Unreal, Unity) for rendering and sensor simulation pipelines. 

  • Experience with PyTorch Lightning or similar large-scale training infrastructure. 

 

Personal Attributes 

  • Bridge-builder: fluent translator between ML researchers, simulation engineers, AV domain experts, and product managers. 

  • Hands-on: you validate assumptions by training models and running simulations, not by writing specs. 

  • Quality-obsessed: you define objective standards where others see subjective judgments. 

  • Pragmatic: you balance "state-of-the-art realism" against "measurably useful for training." 

  • Systems thinker: you understand how every choice in data generation propagates into downstream model performance. 

 

About HERE Technologies

HERE Technologies is a location technology company that provides mapping and location data and related services to individuals and companies. It is headquartered in Chicago, Illinois, and has offices in several other locations around the world. The company's products and services include maps, traffic data, location-based services, and software development tools. HERE Technologies serves a wide range of clients, including automotive companies, technology companies, and governments. The company was originally founded as a joint venture between Nokia and several automotive companies, but is now owned by a consortium of German automotive companies.
Learn more about HERE Technologies
Size
10,000 employees
Industry
Founded
2013

Similar Jobs

More Jobs at HERE Technologies

More Transportation Jobs

Find similar AV Simulation Domain Expert (Sr. Principal) - US (Remote) or Chicago, IL jobs: