All-weather target detection method based on vision and millimeter wave fusion
US11380089B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 7, 2021 |
| Grant date | Jul 5, 2022 |
| Priority date | — |
| Expiry date | Dec 7, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06V20/56
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
An all-weather target detection method based on a vision and millimeter wave fusion includes: simultaneously acquiring continuous image data and point cloud data using two types of sensors of a vehicle-mounted camera and a millimeter wave radar; pre-processing the image data and point cloud data; fusing the pre-processed image data and point cloud data by using a pre-established fusion model, and outputting a fused feature map; and inputting the fused feature map into a YOLOv5 detection network for detection, and outputting a target detection result by non-maximum suppression. The method fully fuses millimeter wave radar echo intensity and distance information with the vehicle-mounted camera images. It analyzes different features of a millimeter wave radar point cloud and fuses the features with image information by using different feature extraction structures and ways, so that the advantages of the two types of sensor data complement each other.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.