Automatic viseme detection for generating animatable puppet
US10825224B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Nov 20, 2018 |
| Grant date | Nov 3, 2020 |
| Priority date | — |
| Expiry date | Nov 20, 2038 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L25/57
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Certain embodiments involve automatically detecting video frames that depict visemes and that are usable for generating an animatable puppet. For example, a computing device accesses video frames depicting a person performing gestures usable for generating a layered puppet, including a viseme gesture corresponding to a target sound or phoneme. The computing device determines that audio data including the target sound or phoneme aligns with a particular video frame from the video frames that depicts the person performing the viseme gesture. The computing device creates, from the video frames, a puppet animation of the gestures, including an animation of the viseme corresponding to the target sound or phoneme that is generated from the particular video frame. The computing device outputs the puppet animation to a presentation device.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.