Deep learning-based facial animation for head-mounted display
US10217261B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Feb 21, 2017 |
| Grant date | Feb 26, 2019 |
| Priority date | — |
| Expiry date | Apr 1, 2037 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06V40/176
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
There is disclosed a system and method for training a set of expression and neutral convolutional neural networks using a single performance mapped to a set of known phonemes and visemes in the form predetermined sentences and facial expressions. Then, subsequent training of the convolutional neural networks can occur using temporal data derived from audio data within the original performance mapped to a set of professionally-created three dimensional animations. Thereafter, with sufficient training, the expression and neutral convolutional neural networks can generate facial animations from facial image data in real-time without individual specific training.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.