Mixed reality environment display using surface reconstruction mesh and live video overlay
US12175612B2 · kind B2 · utility
Assignee
Inventor
Key dates
| Filing date | Nov 29, 2022 |
| Grant date | Dec 24, 2024 |
| Priority date | — |
| Expiry date | Mar 2, 2043 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2219/024
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
The disclosure herein describes enabling a user of a remote mixed reality (MR) device to observe an environment of a local MR device combined with 3D surface reconstruction (SR) mesh data and live video data. Optical data of a surface of an environment is obtained and a 3D surface reconstruction mesh of the surface is generated from the obtained optical data using photogrammetry. The generated 3D surface reconstruction mesh is provided for display by a remote device. A live video feed of a window region of the environment is obtained and the live video feed of the window region is provided for display on the generated 3D surface reconstruction mesh by the remote device. Further, a remote user is enabled to provide feedback to a user of the local MR device, including audio feedback such as speech and virtual artifacts that are displayed to the local user.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.