Method and a system for interacting with physical devices via an artificial-reality device
US12056275B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Oct 20, 2022 |
| Grant date | Aug 6, 2024 |
| Priority date | — |
| Expiry date | Oct 20, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG02B2027/0178
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
An Artificial Reality (AR) device captures an image of a physical environment surrounding a user wearing the AR device. A three-dimensional map corresponding to the physical environment is accessed. Then, a pose of the AR device relative to the three-dimensional map is determined based on first features of physical objects captured in the image and second features of object representations in the three-dimensional map. The device determines, using an eye tracker, a gaze of an eye of the user. Based on the gaze and the pose, a region of interest is computed in the three-dimensional map. Representations of physical devices in the region of interest of the three-dimensional map are identified. The device determines an intent of the user to interact with a physical device. A command is issued to the physical device based on the determined intent.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.