Methods and apparatus for multi-modal prediction using a trained statistical model
US11971963B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | May 8, 2019 |
| Grant date | Apr 30, 2024 |
| Priority date | — |
| Expiry date | Jun 1, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F18/22
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Methods and apparatus for predicting an association between input data in a first modality and data in a second modality using a statistical model trained to represent interactions between data having a plurality of modalities including the first modality and the second modality, the statistical model comprising a plurality of encoders and decoders, each of which is trained to process data for one of the plurality of modalities, and a joint-modality representation coupling the plurality of encoders and decoders. The method comprises selecting, based on the first modality and the second modality, an encoder/decoder pair or a pair of encoders, from among the plurality of encoders and decoders, and processing the input data with the joint-modality representation and the selected encoder/decoder pair or pair of encoders to predict the association between the input data and the data in the second modality.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.