Methods and systems for touchless control with a mobile device
US10620713B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Jun 5, 2019 |
| Grant date | Apr 14, 2020 |
| Priority date | — |
| Expiry date | Jun 5, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N20/10
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Methods and systems for mobile device-based touchless control can include receiving an image of a user and applying a convolutional neural network to the image to determine a feature map. Further, a key-points map and an affinity-field map can be determined based on the feature map, and the pose of the user can be determined based on the maps. The methods and system further include identifying an activation gesture of the user and determining a validity of a bounding box associated with the pose of the user, and tracking the pose of the user and a portion of a body of the user for performing the touchless control. Further, the methods and systems include determining a mapping between the portion of the user's body and a cursor position associated with an application, and moving the cursor position to enable touchless user interaction. Embodiments use computer vision techniques to enable a resource-limited mobile device to conduct the aforementioned steps.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.