Handwriting symbol recognition accuracy using speech input
US8077975B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Feb 26, 2008 |
| Grant date | Dec 13, 2011 |
| Priority date | — |
| Expiry date | Apr 4, 2030 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06V30/36
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Described is a bimodal data input technology by which handwriting recognition results are combined with speech recognition results to improve overall recognition accuracy. Handwriting data and speech data corresponding to mathematical symbols are received and processed (including being recognized) into respective graphs. A fusion mechanism uses the speech graph to enhance the handwriting graph, e.g., to better distinguish between similar handwritten symbols that are often misrecognized. The graphs include nodes representing symbols, and arcs between the nodes representing probability scores. When arcs in the first and second graphs are determined to match one another, such as aligned in time and associated with corresponding symbols, the probability score in the second graph for that arc is used to adjust the matching probability score in the first graph. Normalization and smoothing may be performed to correspond the graphs to one another and to control the influence of one graph on the other.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.