Real-time remote collaboration and virtual presence using simultaneous localization and mapping to construct a 3D model and update a scene based on sparse data
US10380762B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Oct 5, 2017 |
| Grant date | Aug 13, 2019 |
| Priority date | — |
| Expiry date | Oct 5, 2037 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2219/024
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
Described are methods and systems for generating a video stream of a scene including one or more objects. A sensor captures images of objects in a scene. A server coupled to the sensor, for each image, generates an initial 3D model for the objects and an initial 3D model of the scene. The server, for each image, captures pose information of the sensor as the sensor moves in relation to the scene or as the objects move in relation to the sensor. A viewing device receives the models and the pose information from the server. The viewing device captures pose information of the viewing device as the viewing device moves in relation to the scene. The viewing device renders a video stream on a display element using the received 3D models and at least one of the pose information of the sensor or the pose information of the viewing device.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.