Cross modality training of machine learning models
US11587228B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Aug 11, 2020 |
| Grant date | Feb 21, 2023 |
| Priority date | — |
| Expiry date | Apr 6, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06V2201/03
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
There is provided a method, comprising: providing a training dataset including, medical images and corresponding text based reports, and concurrently training a natural language processing (NLP) machine learning (ML) model for generating a NLP category for a target text based report and a visual ML model for generating a visual finding for a target image, by: training the NLP ML model using the text based reports of the training dataset and a ground truth comprising the visual finding generated by the visual ML model in response to an input of the images corresponding to the text based reports of the training dataset, and training the visual ML model using the images of the training dataset and a ground truth comprising the NLP category generated by the NLP ML model in response to an input of the text based reports corresponding to the images of the training dataset.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.