Generating a visually consistent alternative audio for redubbing visual speech
US9922665B2 · kind B2 · utility
9Cited by
1References
18Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Aug 6, 2015 |
| Grant date | Mar 20, 2018 |
| Priority date | — |
| Expiry date | Oct 16, 2035 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L2021/105
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
There are provided systems and methods for generating a visually consistent alternative audio for redubbing visual speech using a processor configured to sample a dynamic viseme sequence corresponding to a given utterance by a speaker in a video, identify a plurality of phonemes corresponding to the dynamic viseme sequence, construct a graph of the plurality of phonemes that synchronize with a sequence of lip movements of a mouth of the speaker in the dynamic viseme sequence, use the graph to generate an alternative phrase that substantially matches the sequence of lip movements of the mouth of the speaker in the video.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.