2027 Summer Intern, PhD, Research, AV Planning

Waymo
Mountain View, CA

Who this role is best for

Best suited to PhD candidates in quantitative fields with reinforcement learning experience working in autonomous vehicle planning and AI research.

Best fit for

  • PhD candidates in AI or robotics with reinforcement learning and deep learning policy training experience
    — “Currently pursuing a PhD in Computer Science, Robotics, Machine Learning, or a related quantitative field”
  • Individuals with a track record of publishing in top AI/robotics conferences and experience in LLM-guided code generation
    — “Track record of peer-reviewed publications at top AI/robotics conferences”
  • Candidates who can independently drive research projects from ideation to results
    — “Proven ability to independently drive an exploratory research problem from ideation to implementation and results”

Things to consider

  • The position requires a hybrid onsite arrangement, which may impact flexibility and location planning
    — “This will be a hybrid onsite internship position”
  • Candidates must apply separately for each of the top 3 roles they are interested in
    — “you will need to apply to each one individually - please apply to the top 3 roles you are interested in”

How to stand out

  • Demonstrate experience with reward function design and policy refinement in autonomous driving contexts
    — “Design, implement, and benchmark a system where LLM meta-agents generate, synthesize, and iteratively refine reward functions for autonomous driving planning policies”
  • Highlight prior work diagnosing policy failure modes and multi-objective trade-offs
    — “Diagnose policy failure modes, reward exploitation, and multi-objective trade-offs”
  • Showcase skills in transferring validated reward formulations into practical planner recipes
    — “Collaborate with scientists engineers to transfer validated reward formulations and tooling into planner recipes”
  • Emphasize experience with Bayesian inference, hierarchical learning, or robust evaluation methods
    — “AI Foundations areas that we are currently focusing on include reinforcement learning, learning from demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust evaluation”
  • Demonstrate ability to document and distill research outcomes for internal and external audiences
    — “Document research outcomes, distill key design patterns, and prepare findings for internal tech transfers and potential conference publication”
Pace · Fast PacedCollaboration · HighAutonomy · HighDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • Designed and implemented a system for generating reward functions
  • Collaborated with scientists and engineers
  • Documented research outcomes
Typical background
PhD in Computer Science, Robotics, Machine Learning

Skills & requirements

Required

Reinforcement-learningDeep-learningReward-functionsAutonomous-drivingTrajectory-optimizationSequential-decision-makingLlm-meta-agentsCode-generationAutomated-reward-discoveryMeta-rlPyTorchJAXPythonMl-engineering

Preferred

Peer-reviewed-publicationsAi-conferences

Stack & domain

PythonReinforcement LearningDeep LearningPyTorchJAXAutonomous Vehicle PlanningTrajectory OptimizationSequential Decision-making

About the role

Original posting from Waymo

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

The mission of the Waymo AI Foundations team is to develop machine learning solutions addressing open problems in autonomous driving, towards the goal of safely operating Waymo vehicles in dozens of cities and under all driving conditions. As part of our work, we also initiate and foster collaborations with other research teams in Alphabet. AI Foundations areas that we are currently focusing on include reinforcement learning, learning from demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust evaluation.

Waymo interns partner with leaders in the industry on projects that create impact to the company. We believe learning is a two-way street: applying your knowledge while providing you with opportunities to expand your skill-set. Interns are an important part of our culture and our recruiting pipeline. Join us at Waymo for a fun and rewarding internship!

You will:

Design, implement, and benchmark a system where LLM meta-agents generate, synthesize, and iteratively refine reward functions for autonomous driving planning policies

Diagnose policy failure modes, reward exploitation, and multi-objective trade-offs, integrating findings back into the automated discovery loop

Collaborate with scientists engineers to transfer validated reward formulations and tooling into planner recipes

Document research outcomes, distill key design patterns, and prepare findings for internal tech transfers and potential conference publication

You have:

Currently pursuing a PhD in Computer Science, Robotics, Machine Learning, or a related quantitative field

Strong hands-on experience in Reinforcement Learning (RL / RLFT) and training deep learning policies with PyTorch or JAX

Demonstrated proficiency in Python and modern ML engineering practices

Familiarity with autonomous vehicle planning, trajectory optimization, or sequential decision-making under uncertainty

We prefer:

Track record of peer-reviewed publications at top AI/robotics conferences (e.g., NeurIPS, ICRA, IROS, CoRL, ICML, ICLR, CVPR)

Experience with LLM-guided code generation, automated reward discovery (e.g., Eureka-like frameworks), or meta-RL methods

Hands-on experience with RL or RLFT training in LLM/VLM/robotics

Proven ability to independently drive an exploratory research problem from ideation to implementation and results

Note: This will be a hybrid onsite internship position. We will accept resumes on a rolling basis until the role is filled. To be in consideration for multiple roles, you will need to apply to each one individually - please apply to the top 3 roles you are interested in.

The expected hourly rate for this full-time position is listed below. Interns are also eligible to participate in the Company’s generous benefits programs, subject to eligibility requirements.Hourly PhD Pay$85—$85 USD

Source: Waymo careers

Similar roles