High-speed real-time scene reconstruction from input image data
US12159358B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 14, 2022 |
| Grant date | Dec 3, 2024 |
| Priority date | — |
| Expiry date | Jun 22, 2043 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2207/20084
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A scene reconstruction model is disclosed that outputs a heightfield for a series of input images. The model, for each input image, predicts a depth map and extracts a feature map. The model builds a 3D model utilizing the predicted depth maps and camera poses for the images. The model raycasts the 3D model to determine a raw heightfield for the scene. The model utilizes the raw heightfield to sample features from the feature maps corresponding to positions on the heightfield. The model aggregates the sampled features into an aggregate feature map. The model regresses a refined heightfield based on the aggregate feature map. The model determines the final heightfield based on a combination of the raw heightfield and the refined heightfield. With the final heightfield, a client device may generate virtual content augmented on real-world images captured by the client device.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.