Structure-based transformers with localization and encoding for chart question answering
US11386114B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Oct 21, 2020 |
| Grant date | Jul 12, 2022 |
| Priority date | — |
| Expiry date | Oct 21, 2040 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06V30/10
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Embodiments are disclosed for determining an answer to a query associated with a graphical representation of data. In particular, in one or more embodiments, the disclosed systems and methods comprise obtaining a visual embedding for a graphical representation of data, the visual embedding representing a plurality of graphical elements. The one or more embodiment further include obtaining a query embedding for a query associated with the graphical representation of data, the query embedding representing a plurality of textual elements of the query with at least one textual element substituted with an identifier for at least one graphical element of the set of graphical elements. The one or more embodiment further include generating a chart sequence from the visual embedding and a query sequence from the query embedding, generating an output sequence based on the graph and the query sequences, and determining an answer to the query from the output sequence.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.