Hierarchical self-attention for machine comprehension
US11721335B2 · kind B2 · utility
0Cited by
1References
20Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Jun 30, 2020 |
| Grant date | Aug 8, 2023 |
| Priority date | — |
| Expiry date | May 21, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L15/18
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method for determining the answer to a query in a document, including: encoding, by an encoder, the query and the document; generating a query-aware context encodings G by a bidirectional attention system using the encoded query and the encoded document; performing a hierarchical self-attention on the query aware document by a hierarchical self-attention system by applying a word to word attention and a word to sentence attention mechanism resulting in a matrix M; and determining the starting word and the ending word of the answer in the document by a span detector based upon the matrix M.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.