Few-shot synthesis of talking heads
US12026833B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Oct 28, 2020 |
| Grant date | Jul 2, 2024 |
| Priority date | — |
| Expiry date | Jan 29, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2207/30201
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Systems and methods are described for utilizing an image processing system with at least one processing device to perform operations including receiving a plurality of input images of a user, generating a three-dimensional mesh proxy based on a first set of features extracted from the plurality of input images and a second set of features extracted from the plurality of input images. The method may further include generating a neural texture based on a three-dimensional mesh proxy and the plurality of input images, generating a representation of the user including at least a neural texture, and sampling at least one portion of the neural texture from the three-dimensional mesh proxy. In response to providing the at least one sampled portion to a neural renderer, the method may include receiving, from the neural renderer, a synthesized image of the user that is previously not captured by the image processing system.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.