Translation of natural language into user interface actions
US10656907B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Nov 3, 2015 |
| Grant date | May 19, 2020 |
| Priority date | — |
| Expiry date | Jul 11, 2036 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F40/40
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Embodiments are directed to methods and systems for deriving automation instructions. In one scenario, a computer system derives automation instructions by performing the following: rendering a user interface (UI) based on information from an information source and receiving natural language inputs from a user, where the natural language inputs specify an element description and an action type for UI elements rendered in the UI. The method also includes identifying UI elements in the UI that match the element descriptions in the natural language input and whose actions are performable according to their specified action type, and mapping the natural language inputs into executable code using information that corresponds to the identified UI elements.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.