System and method for robot supervisory control with an augmented reality user interface
US9880553B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Apr 26, 2016 |
| Grant date | Jan 30, 2018 |
| Priority date | — |
| Expiry date | Apr 26, 2036 |
Classification
- Technology area (CPC Y)Emerging Cross-Sectional Technologies
- CPC primaryY10S901/01
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
Described is a system for robot supervisory control. The system includes an operator device that receives camera imagery from a camera mounted on a robot and three-dimensional (3D) data from a 3D sensor mounted on the robot. The user interface displays a two-dimensional (2D) view of the scene from the camera and 3D sensor data. One or more object markers of objects in the scene are overlaid on the 2D view or 3D sensor data. Viewing the scene, the user can choose a robotic action from a library of actions, which generates a simulation of the robot performing the selected action. The simulation is then rendered and overlaid on top of the 3D sensor data. Moreover, the simulation shows the expected variability of the robot's action. Based on the simulation's outcome, the user can approve and trigger the execution of the action in the real robot.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.