Inserting three-dimensional objects into digital images with consistent lighting via global and local lighting information
US11704865B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jul 22, 2021 |
| Grant date | Jul 18, 2023 |
| Priority date | — |
| Expiry date | Aug 18, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/094
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
This disclosure describes methods, non-transitory computer readable storage media, and systems that generate realistic shading for three-dimensional objects inserted into digital images. The disclosed system utilizes a light encoder neural network to generate a representation embedding of lighting in a digital image. Additionally, the disclosed system determines points of the three-dimensional object visible within a camera view. The disclosed system generates a self-occlusion map for the digital three-dimensional object by determining whether fixed sets of rays uniformly sampled from the points intersects with the digital three-dimensional object. The disclosed system utilizes a generator neural network to determine a shading map for the digital three-dimensional object based on the representation embedding of lighting in the digital image and the self-occlusion map. Additionally, the disclosed system generates a modified digital image with the three-dimensional object inserted into the digital image with consistent lighting of the three-dimensional object and the digital image.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.