Language model with external knowledge base
US11997056B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Aug 29, 2022 |
| Grant date | May 28, 2024 |
| Priority date | — |
| Expiry date | Aug 29, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N5/022
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
The technology described herein receives a natural-language sequence of words comprising multiple entities. The technology then identifies a plurality of entities in the natural-language sequence. The technology generates a masked natural-language sequence by masking a first entity in the natural-language sequence. The technology retrieves, from a knowledge base, information related to a second entity in the plurality of entities. The technology then trains a natural-language model to respond to a query. The training uses a first representation of the masked natural-language sequence, a second representation of the information, and the first entity.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.