Speech detection and enhancement using audio/video fusion
US7269560B2 · kind B2 · utility
9Cited by
0References
20Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Jun 27, 2003 |
| Grant date | Sep 11, 2007 |
| Priority date | — |
| Expiry date | Oct 10, 2025 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L25/78
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A system and method facilitating speech detection and/or enhancement utilizing audio/video fusion is provided. The present invention fuses audio and video in a probabilistic generative model that implements cross-model, self-supervised learning, enabling rapid adaptation to audio visual data. The system can learn to detect and enhance speech in noise given only a short (e.g., 30 second) sequence of audio-visual data. In addition, it automatically learns to track the lips as they move around in the video.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.