Video signal processing systems and methods utilizing automated speech analysis
US6330023A · kind A · utility
Assignee
Inventor
Key dates
| Filing date | Mar 18, 1994 |
| Grant date | Dec 11, 2001 |
| Priority date | — |
| Expiry date | Mar 18, 2014 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04N19/20
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
A method of increasing the frame rate of an image of a speaking person comprises monitoring an audio signal indicative of utterances by the speaking person and the associated video signal. The audio signal corresponds to one or more fields or frames to be reconstructed, and individual portions of the audio signal are associated with facial feature information. The facial information includes mouth formation and position information derived from phonemes or other speech-based criteria from which the position of a speaker's mouth may be reliably predicted. A field or frame of the image is reconstructed using image features extracted from the existing frame and by utilizing the facial feature information associated with a detected phoneme.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.