Photometric registration from arbitrary geometry for augmented reality
US9578226B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jul 31, 2012 |
| Grant date | Feb 21, 2017 |
| Priority date | — |
| Expiry date | Jul 2, 2034 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2215/16
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
Photometric registration from an arbitrary geometry for augmented reality is performed using video frames of an environment captured by a camera. A surface reconstruction of the environment is generated. A pose is determined for the camera with respect to the environment, e.g., using model based tracking using the surface reconstruction. Illumination data for the environment is determined from a video frame. Estimated lighting conditions for the environment are generated based on the surface reconstruction and the illumination data. For example, the surface reconstruction may be used to compute the possible radiance transfer, which may be compressed, e.g., using spherical harmonic basis functions, and used in the lighting conditions estimation. A virtual object may then be rendered based on the lighting conditions. Differential rendering may be used with lighting solutions from the surface reconstruction of the environment and a second surface reconstruction of the environment combined with the virtual object.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.