Method, system, and program product for measuring audio video synchronization using lip and teeth characteristics
US10397646B2 · kind B2 · utility
Inventors
Key dates
| Filing date | Nov 13, 2006 |
| Grant date | Aug 27, 2019 |
| Priority date | — |
| Expiry date | Feb 16, 2033 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04N5/04
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
Method, system, and program product for measuring audio video synchronization. This is done by first acquiring audio video information into an audio video synchronization system. The step of data acquisition is followed by analyzing the audio information, and analyzing the video information. Next, the audio information is analyzed to locate the presence of sounds therein related to a speaker's personal voice characteristics. In Analysis Phase Audio and Video MuEv-s are calculated from the audio and video information, and the audio and video information is classified into vowel sounds including AA, EE, OO, B, V, TH, F, silence, other sounds, and unclassified phonemes. The inner space between the lips are also identified and determined. This information is used to determine and associate a dominant audio class in a video frame. Matching locations are determined, and the offset of video and audio is determined.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.