Analysis and validation of language models
US11829720B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 1, 2020 |
| Grant date | Nov 28, 2023 |
| Priority date | — |
| Expiry date | May 8, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N20/00
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Systems and methods for analysis and validation of language models trained using data that is unavailable or inaccessible are provided. One example method includes, at an electronic device with one or more processors and memory, obtaining a first set of data corresponding to one or more tokens predicted based on one or more previous tokens. The method determines a probability that the first set of data corresponds to a prediction generated by a first language model trained using a user privacy preserving training process. In accordance with a determination that the probability is within a predetermined range, the method determines that the one or more tokens correspond to a prediction associated with the user privacy preserving training process and outputs a predicted token sequence including the one or more tokens and the one or more previous tokens.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.