Text sequence segmentation method, apparatus and device, and storage medium thereof
US11157686B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Apr 29, 2020 |
| Grant date | Oct 26, 2021 |
| Priority date | — |
| Expiry date | Apr 29, 2040 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F40/284
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
The present disclosure, belonging to the technical field of natural language processing, provides a text sequence segmentation method. The method can include acquiring n segmentation sub-results of the text sequence, the n segmentation sub-results being acquired by segmenting the text sequence by n segmentation models, and processing the n segmentation sub-results by a probability determination model branch in a result combination model to acquire a segmentation probability of the each segmentation position. The method can further include processing the segmentation probability of the each segmentation position by an activation function in the result combination model to acquire a segmentation result of the text sequence. According to the present disclosure, using each segmentation position in the text sequence as a unit, segmentation results of a plurality of segmentation models are combined, such that the accuracy of segmentation of a new text can be improved.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.