Augmented shareable video files for robotic process automation
US10817314B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Oct 1, 2019 |
| Grant date | Oct 27, 2020 |
| Priority date | — |
| Expiry date | Oct 1, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F40/14
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
In one general aspect, in an embodiment, a method of performance-enhanced machine-learning model creation is performed by a computer system. The method includes receiving a command to record user interface (UI) activity in a computing environment. The method further includes, responsive to the command: receiving video frames of a live screen output of the computing environment; detecting UI events in the computing environment in relation to the video frames of the live screen output; and determining target applications for the UI events, wherein the target applications are executing in the computing environment. The method also includes generating UI metadata comprising information identifying the UI events and the target applications in relation to the video frames. In addition, the method includes sequentially encoding, in a video file, the video frames together with information sufficient to derive the UI metadata.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.