Tool for offline perception component evaluation

US11782815B2 · kind B2 · utility

Assignee

• Zoox, Inc. · US

Inventors

• Michael Carsten Bosse · Baden-Baden, DE
• Gerry Chen · Atlanta, US
• Subhasis Das · San Mateo, US
• Francesco Papi · Oakland, US
• Zachary Sun · San Francisco, US

Key dates

• Filing date: Jan 21, 2022
• Grant date: Oct 10, 2023
• Expiry date: Jan 21, 2042

Classification

• Technology area (CPC B): Performing Operations; Transporting
• CPC primary: B60W2556/45
• WIPO field: Transport
• WIPO sector: Mechanical engineering

Abstract

A computer-implemented method. Includes obtaining pointwise data indicating, for a plurality of time steps, a pointwise measurement of a state of an object detected by an object detection system. Includes obtaining, from a runtime model, runtime data indicating, for the plurality of time steps, a runtime estimate of the state of the object. Includes processing, by a benchmark model, the pointwise data to determine, for the plurality of time steps, a benchmark estimate of the state of the object. Includes evaluating a metric measuring, for the plurality of time steps, a deviation between the runtime estimate and the benchmark estimate of the state of the object. Includes updating, based on the on the evaluation of the metric, the runtime model.