Learned computer control using pointing device and keyboard actions
US12189870B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jan 30, 2023 |
| Grant date | Jan 7, 2025 |
| Priority date | — |
| Expiry date | Jan 30, 2043 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/0464
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A computer-implemented method for controlling a particular computer to execute a task is described. The method includes receiving a control input comprising a visual input, the visual input including one or more screen frames of a computer display that represent at least a current state of the particular computer; processing the control input using a neural network to generate one or more control outputs that are used to control the particular computer to execute the task, in which the one or more control outputs include an action type output that specifies at least one of a pointing device action or a keyboard action to be performed to control the particular computer; determining one or more actions from the one or more control outputs; and executing the one or more actions to control the particular computer.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.