System and method for manipulating two-dimensional (2D) images of three-dimensional (3D) objects
US11663798B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Oct 13, 2021 |
| Grant date | May 30, 2023 |
| Priority date | — |
| Expiry date | Nov 9, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2219/2024
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Present disclosure discloses an image processing system and method for manipulating two-dimensional (2D) images of three-dimensional (3D) objects of a predetermined class (e.g., human faces). A 2D input image of a 3D object of the predetermined class is manipulated by manipulating physical properties of the 3D object, such as a 3D shape of the 3D input object, an albedo of the 3D input object, a pose of the 3D input object, and lighting illuminating the 3D input object. The physical properties are extracted from the 2D input image using a neural network that is trained to reconstruct the 2D input image. The 2D input image is reconstructed by disentangling the physical properties from pixels of the 2D input image using multiple subnetworks. The disentangled physical properties produced by the multiple subnetworks are combined into a 2D output image using a differentiable renderer.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.