Senior Software Engineer/Data Scientist, Planner Evaluation - Waymo

The Planner Evaluation team works on one of the key challenges in autonomous driving: measuring and improving the quality of the software that drives the car. We are looking for experienced software engineers and data scientists to help us understand and improve the performance of Waymo's ML and robotics systems, and to develop novel performance metrics and measurement techniques. If you are excited about leveraging a large volume of extremely rich data to improve core technology at the very heart of autonomous driving, this is the place for you! In this hybrid role, you will report to the Senior Manager of Planner Evaluation.

In this hybrid role, you will:

• Develop signals to measure the performance of large scale machine learning models that power our self-driving car's behavior, using a range of techniques including statistics, math, physics, and machine learning.
• Use simulation creatively to measure driving performance of novel ML algorithms.
• Work closely with statisticians, machine learning engineers, and roboticists to develop novel solutions to open problems.
• Build data pipelines for signal discovery, data labeling, feature extraction and metric computation based on large-scale simulations.
• Create tooling for metric aggregation, reporting, and visualization that are tailored for behavioral evaluation.
• Spin up continuous monitoring and validation of metric signals, anomaly detection and root cause identification.

We'd like you to have:

• BS in Computer Science, Robotics, Statistics, Physics, Math or another quantitative area
• 5 years of industry experience 
• Python, especially for modeling and/or statistical computing 
• Experience with tools for large-scale parallel compute and data manipulation (Apache Beam, SQL)
• Experience with evaluating the quality of machine learning prediction quality at scale.
• Problem-oriented mindset instead of only a solutions-oriented approach

It's preferred if you have:

• PhD in Computer Science, Robotics, Statistics, Physics, Math or another quantitative area
• 7+ years preferred
• Comfort with writing production code in Tensorflow / JAX
• Experience with large-scale parallel compute
• Experience in robotics or with spatial data in another field