Chart question answering
US11288324B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jan 22, 2020 |
| Grant date | Mar 29, 2022 |
| Priority date | — |
| Expiry date | May 15, 2040 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/045
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method, apparatus, and non-transitory computer readable medium for chart question answering are described. The method, apparatus, and non-transitory computer readable medium may receive a text query about a chart, identify a plurality of chart elements in the chart, associate a text string from the text query with corresponding chart elements from the plurality of chart elements, replace the text string in the text query with arbitrary rare words based on the association to produce an encoded query, generate an embedded query based on the encoded query, generate an image feature vector based on the chart, combine the embedded query and the image feature vector to produce a combined feature vector, compute an answer probability vector based on the combined feature vector, and provide an answer to the text query based on the answer probability vector.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.