Methods and systems for multimodal hand state prediction
US11782522B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Mar 25, 2022 |
| Grant date | Oct 10, 2023 |
| Priority date | — |
| Expiry date | Mar 25, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F2203/04106
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
In various examples, the present disclosure describes methods and systems for generating hand state predictions. A hand state prediction system includes a machine learning-based model, such as a neural network model, that is trained to convert inertial motion measurements and surface contact data into predictions of a corresponding hand gesture or gripping posture. For each window of data sampled, motion data and contact data are obtained, processed and fused to generate a fused prediction. The hand state prediction system can operate in continuous mode to automatically detect a start and an end of a hand action, or a user can designate a start and an end of a hand action. A hand state prediction is generated by a multimodal classifier by processing the fused prediction. Instructions represented by a hand action can be acted upon through a command action performed by a computing device or a computer application.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.