Transcribing augmented reality keyboard input based on hand poses for improved typing accuracy
US10719173B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Apr 4, 2018 |
| Grant date | Jul 21, 2020 |
| Priority date | — |
| Expiry date | Sep 19, 2038 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06V40/174
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A transcription engine transcribes input received from an augmented reality keyboard based on a sequence of hand poses performed by a user when typing. A hand pose generator analyzes video of the user typing to generate the sequence of hand poses. The transcription engine implements a set of transcription models to generate a series of keystrokes based on the sequence of hand poses. Each keystroke in the series may correspond to one or more hand poses in the sequence of hand poses. The transcription engine monitors the behavior of the user and selects between transcription models depending on the attention level of the user. The transcription engine may select a first transcription model when the user types in a focused manner and then select a second transcription model when the user types in a less focused, conversational manner.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.