Hand tracking using an ultrasound sensor on a head-mounted display
US10955932B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 11, 2019 |
| Grant date | Mar 23, 2021 |
| Priority date | — |
| Expiry date | Dec 11, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N20/10
- WIPO fieldMeasurement
- WIPO sectorInstruments
Abstract
A head-mounted display (HMD) tracks a user's hand positions, orientations, and gestures using an ultrasound sensor coupled to the HMD. The ultrasound sensor emits ultrasound signals that reflect off the hands of the user, even if a hand of the user is obstructed by the other hand. The ultrasound sensor identifies features used to train a machine learning model based on detecting reflected ultrasound signals. For example, one of the features is the time delay between consecutive reflected ultrasound signals detected by the ultrasound sensor. The machine learning model learns to determine poses and gestures of the user's hands. The HMD optionally includes a camera that generates image data of the user's hands. The image data can also be used to train the machine learning model. The HMD may perform a calibration process to avoid detecting other objects and surfaces such as a wall next to the user.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.