Techniques for automated control of computer programs through text-based user interfaces
US11610052B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Aug 16, 2019 |
| Grant date | Mar 21, 2023 |
| Priority date | — |
| Expiry date | Aug 16, 2039 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L67/08
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Techniques for programmatically controlling computer programs that are configured to be controlled via text-based user interfaces. The techniques include using at least one computer hardware processor to perform: accessing a string specifying content of a user interface (UI) screen of a computer program configured to be controlled via a text-based user interface; generating, based on the string, a two-dimensional (2D) representation of the UI screen; identifying a first controllable UI element in the UI screen at least in part by processing text in the 2D representation of the UI screen; and controlling the computer program by causing, via the first controllable UI element, the computer program to perform at least one action in furtherance of a task.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.