Research Scientist, Robot Learning - Continual Adaptation

Toyota Research Institute
Cambridge, MA
Hybrid

Who this role is best for

Best suited to researchers with expertise in generative robot policies and reinforcement learning working in robotics and embodied AI domains, in a full-time, collaborative setting in Cambridge, MA.

Best fit for

  • Candidates with a Ph.D. or M.S. in robotics or AI and experience in policy adaptation and real-world robot deployments
    — “Ph.D. or M.S. in Robotics, Machine Learning, Computer Vision, or a related field, or equivalent applied research experience.”
  • Individuals with a strong background in reinforcement learning and deep learning frameworks like PyTorch or JAX
    — “Strong proficiency with deep learning frameworks such as PyTorch or JAX and robotics simulation environments such as IsaacLab or MuJoCo.”
  • Researchers who have published in top-tier robotics and AI conferences and can work across interdisciplinary teams
    — “Publications in top-tier conferences such as CoRL, RSS, NeurIPS, ICLR, ICML, ICRA, or CVPR.”

Things to consider

  • Strong emphasis on real-world hardware experience and reproducibility of research systems.
    — “Prior robotics experience with real-world hardware and ML-based robot deployments.”

How to stand out

  • Highlight experience with human-in-the-loop learning and generative robot policies in your resume and interviews.
    — “Experience with human-in-the-loop robot learning (e.g., DAgger), preference learning, reward learning, or RLHF/RLAIF.”
  • Emphasize your ability to deploy scalable and reproducible research systems in collaborative environments.
    — “Collaborate across teams in perception, control, foundation models, and ML infrastructure to deploy scalable and reproducible research systems.”
  • Demonstrate your coding and experimental skills with a focus on rigorous evaluation methods.
    — “Strong coding and experimental skills with an emphasis on reproducibility and rigorous evaluation.”
Pace · Fast PacedCollaboration · HighAutonomy · HighDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • publishing research outcomes
  • contributing to open robotics and embodied AI communities
Typical background
Ph.D. or M.S. in Robotics, Machine Learning, Computer Vision, or a related field

Skills & requirements

Required

Reinforcement LearningImitation LearningDeep Learning FrameworksRobotics Simulation EnvironmentsPolicy AdaptationContinual LearningPreference LearningRobotics ExperiencePublications In Top-tier Conferences

Preferred

Human-in-the-loop Robot LearningGenerative Robot PoliciesRobot Data Collection InfrastructureReal-world Robot Platforms

Stack & domain

Reinforcement LearningImitation LearningDeep Learning FrameworksRobotics Simulation EnvironmentsPolicy AdaptationContinual LearningPreference LearningReward LearningRlhf/rlaifGenerative Robot PoliciesVlasRobot Data CollectionReplay InfrastructureReal-world Robot PlatformsCollaborationCoding And Experimental SkillsReproducibilityRigorous EvaluationAIRoboticsDrivingMaterial Sciences

About the role

Original posting from Toyota Research Institute via Lever

At Toyota Research Institute (TRI), we’re on a mission to improve the quality of human life. We’re developing new tools and capabilities to amplify the human experience. To lead this transformative shift in mobility, we’ve built a world-class team advancing the state of the art in AI, robotics, driving, and material sciences.

The Vision

We envision a future with robots that help people in our real environments through interactions that allow robots to understand, adapt, and grow with us. We believe that robots should and will work well alongside people: helping where wanted, and ultimately enabling people to spend more time on the activities they enjoy most. To achieve this, robots need to be able to operate reliably in messy, unstructured environments. We must also create robots that people can understand, collaborate with, and rely on.

The Team

Our goal is to revolutionize the field of robotics, enabling long-horizon dexterous behaviors to be efficiently taught, learned, and improved over time in diverse, real-world environments with people.

Our team has deep cross-functional expertise across hardware, simulation, perception, controls, machine learning, and human-robot interaction. We measure our success in terms of the development of fundamental capabilities, as well as research impact through open-source software and publications. Come join us in developing technologies that help people thrive!

The Opportunity

We are seeking a creative and technically strong researcher to advance post-training methods for generative robot policies. This role focuses on enabling pretrained robot policies to adapt rapidly from experience and human feedback, improve through autonomous interaction and collaboration, and retain useful capabilities over time.

You will develop algorithms and frameworks for post-training and continual learning in robot foundation models, with the goal of allowing robots to improve after deployment without retraining from scratch.

Responsibilities:

-

Design and implement methods for adapting generative robot policies using techniques such as reinforcement learning, imitation learning, agentic tool use, and related methods.

-

Develop methods that enable generative robot policies to improve through ongoing interaction with people and the environment, using signals such as demonstrations, interventions, preference feedback, learned rewards, and other human-driven signals.

-

Develop rollout-based learning and exploration strategies that enable robots to efficiently and safely gather useful experience, leveraging multimodal data from demonstrations, teleoperation, interventions, and on-policy rollouts. In both simulation and on real robot hardware.

-

Collaborate across teams in perception, control, foundation models, and ML infrastructure to deploy scalable and reproducible research systems.

-

Publish research outcomes and contribute to the open robotics and embodied AI communities.

Qualifications:

-

Ph.D. or M.S. in Robotics, Machine Learning, Computer Vision, or a related field, or equivalent applied research experience.

-

Strong background in reinforcement learning, imitation learning, or closely related robot-learning methods.

-

Strong proficiency with deep learning frameworks such as PyTorch or JAX and robotics simulation environments such as IsaacLab or MuJoCo.

-

Experience with policy adaptation, continual learning, preference learning, or related learning problems in embodied settings.

-

Strong coding and experimental skills with an emphasis on reproducibility and rigorous evaluation.

-

Prior robotics experience with real-world hardware and ML-based robot deployments.

-

Publications in top-tier conferences such as CoRL, RSS, NeurIPS, ICLR, ICML, ICRA, or CVPR.

Bonus Qualifications:

-

Experience with human-in-the-loop robot learning (e.g., DAgger), preference learning, reward learning, or RLHF/RLAIF.

-

Prior work on generative robot policies or VLAs such as π0.5, GR00T, or related models.

-

Experience building or managing robot data collection or replay infrastructure.

-

Familiarity with real-world robot platforms such as YAMs, Kinova, humanoids, or mobile manipulators.

The pay range for this position at commencement of employment is expected to be between $158,400  and $227,700 /year for Massachusetts-based roles. Base pay offered will depend on multiple individualized factors, including, but not limited to, a candidate's experience, skills, job-related knowledge, and market location. TRI offers a generous benefits package including medical, dental, and vision insurance, 401(k) eligibility, paid time off benefits (including vacation, sick time, and parental leave), and an annual cash bonus structure. Additional details regarding these benefit plans will be provided if an employee receives an offer of employment.

Please reference this Candidate Privacy Notice to inform you of the categories of personal information that we collect from individuals who inquire about and/or apply to work for Toyota Research Institute, Inc. or its subsidiaries, including Toyota A.I. Ventures GP, L.P., and the purposes for which we use such personal information.

TRI is fueled by a diverse and inclusive community of people with unique backgrounds, education and life experiences. We are dedicated to fostering an innovative and collaborative environment by living the values that are an essential part of our culture. We believe diversity makes us stronger and are proud to provide Equal Employment Opportunity for all, without regard to an applicant’s race, color, creed, gender, gender identity or expression, sexual orientation, national origin, age, physical or mental disability, medical condition, religion, marital status, genetic information, veteran status, or any other status protected under federal, state or local laws.

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability. Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records for employment.

Source: Toyota Research Institute careers (Lever)

Similar roles

More roles at Toyota Research Institute