2027 Summer Intern, PhD, Research, VLM Harnesses for AV Planning

Waymo
Mountain View, CA
On-site

Who this role is best for

A natural match if you have experience in vision-language models and deep learning applied to autonomous driving.

Best fit for

  • PhD candidates with deep learning and generative model experience in autonomous driving or computer vision
    — “3+ years of experience with Deep Learning, Computer Vision, and Generative Models”
  • Candidates who have used coding agents for auto-research and can translate complex outputs into practical applications
    — “Experience using coding agents for auto-research”

Things to consider

  • This role requires a hybrid onsite commitment, which may affect work-life balance or location flexibility
    — “This will be a hybrid onsite internship position”
  • Applicants must apply to each role individually, even if they are interested in multiple positions
    — “you will need to apply to each one individually - please apply to the top 3 roles you are interested in”

How to stand out

  • Emphasize your experience with multimodal prompting and scene representations in your resume and interview responses
    — “Design and implement scenario preprocessors (e.g., visual rendering, scene representations, and multimodal prompting)”
  • Showcase your ability to translate research outputs into actionable vehicle control systems
    — “Develop postprocessors that translate VLM outputs into feasible, safe trajectories for closed-loop vehicle control”
  • Highlight your prior work in robust evaluation of AI systems or autonomous driving simulation
    — “Evaluate VLM driving harnesses in closed-loop autonomous driving simulation and iterate on representations based on driving metrics”
  • Demonstrate your ability to communicate technical research to non-technical audiences effectively
    — “Communicate to both technical and non-technical audiences regarding research motivations and research findings”
  • Include evidence of academic or industry publications in your application materials
    — “Publications at top-tier conferences such as CVPR/ICCV/ECCV/ICLR/ICML/NeurIPS/IROS/CoRL etc.”
Pace · SteadyCollaboration · MediumAutonomy · MediumDecision Impact · Individual

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • design and implement scenario preprocessors
  • develop postprocessors
  • evaluate VLM driving harnesses
Typical background
PhD program in computer science, statistics, applied mathematics, physics3+ years of experience with Deep Learning, Computer Vision, and Generative Models

Skills & requirements

Required

Deep LearningComputer VisionGenerative ModelsVlms/llmsCoding Agents For Auto-research

Preferred

Publications At Top-tier ConferencesSubstantial Involvement In And Contributions To High Impact Industry AI Projects

Stack & domain

Deep LearningComputer VisionGenerative ModelsVlms/llmsJAXPyTorchCoding Agents For Auto-researchVisual RenderingScene RepresentationsMultimodal PromptingClosed-loop Vehicle ControlAutonomous Driving Simulation And PlanningTechnical CommunicationResearchPublicationsAIAutonomous DrivingMachine LearningBayesian InferenceHierarchical LearningRobust Evaluation

About the role

Original posting from Waymo

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

The mission of the Waymo AI Foundations team is to develop machine learning solutions addressing open problems in autonomous driving, towards the goal of safely operating Waymo vehicles in dozens of cities and under all driving conditions. As part of our work, we also initiate and foster collaborations with other research teams in Alphabet. AI Foundations areas that we are currently focusing on include reinforcement learning, learning from demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust evaluation.

Waymo interns partner with leaders in the industry on projects that create impact to the company. We believe learning is a two-way street: applying your knowledge while providing you with opportunities to expand your skill-set. Interns are an important part of our culture and our recruiting pipeline. Join us at Waymo for a fun and rewarding internship!

You will:

Design and implement scenario preprocessors (e.g., visual rendering, scene representations, and multimodal prompting) to effectively present driving scenarios to state-of-the-art VLMs

Develop postprocessors that translate VLM outputs into feasible, safe trajectories for closed-loop vehicle control

Evaluate VLM driving harnesses in closed-loop autonomous driving simulation and iterate on representations based on driving metrics

Communicate to both technical and non-technical audiences regarding research motivations and research findings

Conduct cutting-edge research and potentially communicate research findings to the wider academic community via technical reports and/or publications

You have:

Currently enrolled in a PhD program in computer science, statistics, applied mathematics, physics, or a related technical field of study

Familiarity with major ML Frameworks (JAX, Pytorch)

Experience using coding agents for auto-research

3+ years of experience with Deep Learning, Computer Vision, and Generative Models (such as VLMs/LLMs)

We prefer:

Publications at top-tier conferences such as CVPR/ICCV/ECCV/ICLR/ICML/NeurIPS/IROS/CoRL etc.

Substantial involvement in and contributions to high impact industry AI projects

Experience with Vision-Language Models (VLMs), multimodal prompting/reasoning, or autonomous driving simulation and planning

Note: This will be a hybrid onsite internship position. We will accept resumes on a rolling basis until the role is filled. To be in consideration for multiple roles, you will need to apply to each one individually - please apply to the top 3 roles you are interested in.

The expected hourly rate for this full-time position is listed below. Interns are also eligible to participate in the Company’s generous benefits programs, subject to eligibility requirements.Hourly PhD Pay$85—$85 USD

Source: Waymo careers

Similar roles