System for image compositing including training with custom synthetic data
US11158073B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 23, 2020 |
| Grant date | Oct 26, 2021 |
| Priority date | — |
| Expiry date | Dec 23, 2040 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04N2013/0081
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
Embodiments allow live action images from an image capture device to be composited with computer generated images in real-time or near real-time. The two types of images (live action and computer generated) are composited accurately by using a depth map. In an embodiment, the depth map includes a “depth value” for each pixel in the live action image. In an embodiment, steps of one or more of feature extraction, matching, filtering or refinement can be implemented, at least in part, with an artificial intelligence (AI) computing approach using a deep neural network with training. A combination of computer-generated (“synthetic”) and live-action (“recorded”) training data is created and used to train the network so that it can improve the accuracy or usefulness of a depth map so that compositing can be improved.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.