3D plane detection and reconstruction using a monocular image
US11037051B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Sep 10, 2019 |
| Grant date | Jun 15, 2021 |
| Priority date | — |
| Expiry date | Dec 4, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2207/30261
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Planar regions in three-dimensional scenes offer important geometric cues in a variety of three-dimensional perception tasks such as scene understanding, scene reconstruction, and robot navigation. Image analysis to detect planar regions can be performed by a deep learning architecture that includes a number of neural networks configured to estimate parameters for the planar regions. The neural networks process an image to detect an arbitrary number of plane objects in the image. Each plane object is associated with a number of estimated parameters including bounding box parameters, plane normal parameters, and a segmentation mask. Global parameters for the image, including a depth map, can also be estimated by one of the neural networks. Then, a segmentation refinement network jointly optimizes (i.e., refines) the segmentation masks for each instance of the plane objects and combines the refined segmentation masks to generate an aggregate segmentation mask for the image.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.