Cross-modality processing method and apparatus, and computer storage medium
US11341366B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Aug 10, 2020 |
| Grant date | May 24, 2022 |
| Priority date | — |
| Expiry date | Aug 10, 2040 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06V2201/10
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A cross-modality processing method is related to a field of natural language processing technologies. The method includes: obtaining a sample set, wherein the sample set includes a plurality of corpus and a plurality of images; generating a plurality of training samples according to the sample set, in which each of the plurality of the training samples is a combination of at least one of the plurality of the corpus and at least one of the plurality of the images corresponding to the at least one of the plurality of the corpus; adopting the plurality of the training samples to train a semantic model, so that the semantic model learns semantic vectors containing combinations of the corpus and the images.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.