Combined lip reading and voice recognition multimodal interface system
US8442820B2 · kind B2 · utility
Assignees
Inventors
Key dates
| Filing date | Dec 1, 2009 |
| Grant date | May 14, 2013 |
| Priority date | — |
| Expiry date | Jul 17, 2031 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L15/25
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
The present invention provides a combined lip reading and voice recognition multimodal interface system, which can issue a navigation operation instruction only by voice and lip movements, thus allowing a driver to look ahead during a navigation operation and reducing vehicle accidents related to navigation operations during driving. The combined lip reading and voice recognition multimodal interface system in accordance with the present invention includes: an audio voice input unit; a voice recognition unit; a voice recognition instruction and estimated probability output unit; a lip video image input unit; a lip reading unit; a lip reading recognition instruction output unit; and a voice recognition and lip reading recognition result combining unit that outputs the voice recognition instruction
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.