2027 Summer Intern, PhD, Machine Learning - Simulation & Closed-Loop Training
WaymoMountain View, California, United StatesOn-Site
Needs a free Superjobs account. You'll finish on Waymo's site.
Skill score
Summary
This summer intern works on reinforcement learning post-training and learned reward models inside Waymo's closed-loop driving simulator, running large ablation studies on TPU clusters and writing JAX code. It suits a PhD student in machine learning or robotics with strong Python and JAX or PyTorch skills and research experience in RL or generative trajectory modeling.
- Function
- Data Science
- Estimated salary
- Est. $36k–54k/yr
- Estimated for an internship, United States. Not published by the employer.
- Work mode and location
- On-Site, Mountain View, California, United States
- Employment type
- Internship
Job description
Overview
Software Engineering builds the brains of Waymo's fully autonomous driving technology. Our software allows the Waymo Driver to perceive the world around it, make the right decision for every situation, and deliver people safely to their destinations. We think deeply and solve complex technical challenges in areas like robotics, perception, decision-making and deep learning, while collaborating with hardware and systems engineers. If you’re a software engineer or researcher who’s curious and passionate about Level 4 autonomous driving, we'd like to meet you.
Roles and responsibilities
- Design, implement, and scale Reinforcement Learning post-training and distillation algorithms (such as flow or diffusion policy optimization, off-policy importance sampling, and constrained multi-objective RL) for foundation world models in simulation and autonomous driving
- Develop learned reward models, realism critics, and discriminators within a closed-loop multi-agent simulator to align simulated agent and driving behaviors with human driving realism and safety
- Run rigorous closed-loop ablation studies on large-scale TPU clusters—leveraging agentic auto-research workflows and fleet-scale driving behavior metrics (such as route progress, braking comfort, lateral stability, and lane selection)—to mitigate simulator exploitation and distribution shift
- Write clean, modular, and well-tested JAX code in core simulation and autonomous driving codebases, collaborating closely with researchers and engineers across simulation, world modeling, and autonomous driving teams
Skills required
Top skills
- Reinforcement learning
- JAX
All skills (9)
- Python
- Diffusion and flow models
- Closed-loop simulation
- TPU clusters
- Distributed training
- XLA compilation
- C++
- Flax
- PyTorch
Qualifications
- Currently pursuing a PhD in Computer Science, Machine Learning, Robotics, or a related technical field, with an anticipated graduation date between December 2027 and August 2028 (returning to a degree program for at least one academic term after the internship)
- Core Implementation Fluency (Mandatory): Strong tensor implementation and debugging skills in Python and JAX/Flax or PyTorch, with hands-on experience training and modifying modern neural architectures (such as Transformers, Diffusion/Flow models, or deep RL networks)
- Deep Research Expertise in Either (a) Reinforcement Learning & Post-Training (hands-on research experience in policy gradient methods such as PPO/GRPO/REINFORCE, off-policy or offline RL such as importance sampling/AWR/DPO, constrained MDPs, inverse RL, or learned reward and critic modeling) OR (b) Generative World, Sequence, or Trajectory Modeling (hands-on research experience in continuous flow matching / Rectified Flows, score-based diffusion policies such as DDPO/DPPO/Diffuser, or spatiotemporal autoregressive world and trajectory models), with working familiarity in the other
Nice to have
- First-author publications at top-tier machine learning or robotics venues (e.g., NeurIPS, ICML, ICLR, CVPR, CoRL, RSS, ICRA, or equivalent venues) in RL post-training, flow/diffusion policy optimization, generative world models, or autonomous driving
- Experience with multi-agent closed-loop simulation, Sim2Real transfer, or reward-hacking mitigation (e.g., Waymax, WOMD, NuPlan, IsaacGym/MuJoCo, adversarial traffic generation, or discriminator stabilization)
- Experience profiling and scaling distributed training workloads on TPUs or multi-node GPUs (such as XLA compilation, vectorized batched rollouts, and memory optimization) and familiarity with C++/Python interfaces
Other details
Note: This will be a hybrid onsite internship position. We will accept resumes on a rolling basis until the role is filled. To be in consideration for multiple roles, you will need to apply to each one individually - please apply to the top 3 roles you are interested in.
Benefits
The expected hourly rate for this full-time position is listed below. Interns are also eligible to participate in the Company’s generous benefits programs, subject to eligibility requirements.
Compensation
$85—$85 USD
Company info
About Waymo
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now