Depth from motion for augmented reality for handheld user devices
US11145075B2 · kind B2 · utility
Assignee
Inventors
- Julien Pascal Christophe Valentin
- Onur G. Guleryuz
- Mira Leung
- Maksym Dzitsiuk
- José Carlos Maranhão Pascoal
- Mirko Schmidt
- Christoph Rhemann
- Neal Wadhwa
- Eric Turner
- Sameh Khamis
- Adarsh Prakash Murthy Kowdle
- Ambrus Csaszar
- Joao Afonso
- Jonathan Tilton Barron
- Michael Schoenberg
- Ivan Dryanovski
- Vivek Verma
- Vladimir Tankovich
- Shahram Izadi
- Sean Ryan Francesco Fanello
- Konstantine Nicholas John Tsotsos
Key dates
| Filing date | Oct 4, 2019 |
| Grant date | Oct 12, 2021 |
| Priority date | — |
| Expiry date | Oct 4, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T7/571
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A handheld user device includes a monocular camera to capture a feed of images of a local scene and a processor to select, from the feed, a keyframe and perform, for a first image from the feed, stereo matching using the first image, the keyframe, and a relative pose based on a pose associated with the first image and a pose associated with the keyframe to generate a sparse disparity map representing disparities between the first image and the keyframe. The processor further is to determine a dense depth map from the disparity map using a bilateral solver algorithm, and process a viewfinder image generated from a second image of the feed with occlusion rendering based on the depth map to incorporate one or more virtual objects into the viewfinder image to generate an AR viewfinder image. Further, the processor is to provide the AR viewfinder image for display.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.