Method for pre-training model, device, and storage medium
US12314677B2 · kind B2 · utility
0Cited by
0References
20Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Aug 16, 2022 |
| Grant date | May 27, 2025 |
| Priority date | — |
| Expiry date | May 31, 2043 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F40/56
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method and apparatus for pre-training a model, a device, a storage medium, and a program product. An embodiment of the method includes: acquiring a sample natural language text; generating N types of prompt words based on the sample natural language text, where N is a positive integer; generating sample input data based on the sample natural language text and the N types of prompt words; and training an initial language model based on the sample input data, to obtain a pre-trained language model.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.