Methods and devices for producing and using synthetic visual speech based on natural coarticulation
US6539354B1 · kind B1 · utility
150Cited by
60References
54Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Mar 24, 2000 |
| Grant date | Mar 25, 2003 |
| Priority date | — |
| Expiry date | Mar 24, 2020 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L2021/105
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method of producing synthetic visual speech according to this invention includes receiving an input containing speech information. One or more visemes that correspond to the speech input are then identified. Next, the weights of those visemes are calculated using a coarticulation engine including viseme deformability information. Finally, a synthetic visual speech output is produced based on the visemes' weights over time (or tracks). The synthetic visual speech output is combined with a synchronized audio output corresponding to the input to produce a multimedia output containing a 3D lipsyncing animation.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.