Sequential fusion for 3D object detection
US11214281B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Nov 12, 2020 |
| Grant date | Jan 4, 2022 |
| Priority date | — |
| Expiry date | Nov 12, 2040 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2210/12
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Techniques are provided for improving a perception processing pipeline for object detection that fuses image segmentation data (e.g., segmentation scores) with LiDAR points. The disclosed techniques are implemented using an architecture that accepts point clouds and images as input and estimates oriented 3D bounding boxes for all relevant object classes. In an embodiment, a method comprises: matching temporally, using one or more processors of a vehicle, points in a three-dimensional (3D) point cloud with an image; generating, using an image-based neural network, semantic data for the image; decorating, using the one or more processors, the points in the 3D point cloud with the semantic data; and estimating, using a 3D object detector with the decorated points as input, oriented 3D bounding boxes for the one or more objects.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.