Research Scientist: Hierarchical RL Agents

Astera

$100K — $150K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • PhD in Computer Science, Electrical Engineering, Neuroscience, Physics, or related field preferred; exceptional non-traditional candidates considered.
  • Strong foundations in deep learning, graphical models, and information theory are necessary.
  • Expert-level skills in deep learning frameworks such as PyTorch or JAX, focusing on clean, reproducible research.
  • Demonstrated interest in AI-robustness, generalization, and common-sense reasoning.
  • Genuine passion for the computational principles of the mammalian brain is a plus.
  • Ability to thrive in a lean, fast-paced startup environment with high autonomy.

Responsibilities

  • Conduct fundamental research on hierarchical world model learning from experience.
  • Develop and implement architectures and algorithms for hierarchical RL to facilitate world modeling and planning.
  • Design tasks for agent evaluation in ethologically constrained environments and benchmark various agent designs.
  • Design experiments that test hypotheses related to high-level cognition, causal representations, sensory-motor integration, and unsupervised learning.
  • Collaborate across disciplines with neuroscientists and software engineers to turn abstract concepts into scalable systems.
  • Contribute to open science by innovating publication models and promoting open access research.

Benefits

  • No pressure to align research with financial goals, allowing focus on fundamental breakthroughs in AGI.
  • Direct contribution to global knowledge and the safe development of AGI.
  • Collaborative culture centered around challenge problems, avoiding the inertia and politics typical of larger corporations.
Full Job Description
Astera Institute

Research Scientist: Hierarchical RL Agents

About the Role

We are seeking brilliant, unconventional thinkers to join us. In this role, you will not be chasing incremental gains on standard benchmarks. Instead, you will be tasked with developing the foundational principles of Artificial General Intelligence. We believe that understanding the "code of the brain" is the most viable path to building truly intelligent machines, and we are looking for scientists who can bridge the gap between biological intelligence, computational theory, and building at scale.

Core Responsibilities
  • Fundamental Research on Hierarchical World Model Learning from Experience: Develop and implement new architectures and learning/inference algorithms for hierarchical RL that supports hierarchical world modeling and hierarchical planning.
  • Ethologically constrained learning: Design tasks to evaluate the agent in ethologically constrained environments, and benchmark different agent designs. Design experiments to test hypotheses regarding high-level cognition, causal representations, sensory-motor integration, active inference, and unsupervised learning.
  • Cross-Disciplinary Collaboration: Work alongside neuroscientists and software engineers to translate abstract mathematical frameworks into scalable systems.
  • Contribute to Open Science: Help innovate new publication models that incentivize speedy dissemination, open source code releases, free open access, and impact measurements based on uptake.


Desired Qualifications
  • Technical Depth: Preferred: PhD in Computer Science, Electrical Engineering, Neuroscience, Physics, or a related quantitative field. We are always open to considering exceptional candidates, even those with non-traditional educational histories.
  • Theoretical Rigor: Strong foundations in deep learning, graphical models, and information theory.
  • Coding Proficiency: Expert-level skills in deep learning frameworks (PyTorch/JAX), with a focus on clean, reproducible research code.
  • AGI Mindset: A demonstrated interest in the "big questions" of AI-robustness, generalization, and common-sense reasoning.
  • Curious About the Brain: A genuine passion for exploring the computational and architectural principles of the mammalian brain.
  • Startup DNA: Ability to thrive in a lean, fast-paced environment where you have high autonomy and a direct influence on research direction.


Why Join Us?
  • We recognize the need for fundamental research: No pressure to align research with quarterly revenue goals, market competition, or product roadmaps. We can focus on solving the core problems and achieving breakthroughs that enable the next generation of AGI technology.
  • Mission-First: Your work contributes directly to the global pool of knowledge and the safe development of AGI.
  • Collaborative culture: We work in teams, organized around challenge problems and attack paths, without big-company inertia or politics.

Similar Jobs

More Jobs at Astera

More Information Technology Jobs

Find similar Research Scientist: Hierarchical RL Agents jobs: