Product Manager, Evaluation

Waymo's Product Management Team is a mission-driven team responsible for writing and enacting first-of-their-kind playbooks to bring fully autonomous driving technology to market. Our team develops simple solutions for complex problems by orchestrating cross-functional efforts to safely drive Waymo's technology and the products it enables forward. We do this by understanding the customer, the business, and the technology. We are humble about the scope of our work, collaborative in our approach to problem-solving, and ambitious about our vision for the future.

In this Hybrid role, you will report to a Group Product Manager

You will:

• Understand our users -- there are many different ways we leverage simulation to make data-driven decisions at Waymo: improve models that drive the car, assess our performance in a new environment or validate the readiness of a new vehicle platform. Each of these decisions requires a commitment to safety
• Work with a team of world class data scientists, engineers, machine learning practitioners to evaluate the safety of our driving behavior in a data-driven way.
• Power the launch of the Waymo Driver in new environments (markets, vehicle platforms, and driving scopes) by designing and executing an evaluation plan.
• Land features throughout simulation (such as synthetic data generation, sensor simulation and simulated agents) to increase signal and improve our ability to learn from simulation
• Work closely with Onboard developers who use our products to assess large model launches, to build sim & eval products that increase the quality and speed of launches.
• Develop a scalable framework to evaluate our driving performance across multiple street types, geos, and hardware platforms

You have:

• 2+ years experience working on AV, Robotics, or products that utilize Machine Learning or AI
• Experience in analytical or machine learning roles, collaborating with SW engineers and data scientists
• Ability to think about long-term product vision, and then decompose that into concrete, actionable plans with cross-org alignment

We prefer:

• Experience with Simulation or Evaluation of AVs, Large Foundational Model training / evaluation pipelines or the evaluation / experimentation platforms for large production systems (Ads, Search, Ranking, etc..)
• Experience launching new features in an evaluation / experimentation platform used by Data Scientists or engineers
• Experience building tools, especially simulation or eval platforms used by engineers and / or data scientists. Emphasis on building simple, guided User Experiences.
• Master's degree in a technical or engineering field, or equivalent practical experience