Systems, methods, and apparatus for diagnostic inferencing with a multimodal deep memory network
US11621075B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Sep 5, 2017 |
| Grant date | Apr 4, 2023 |
| Priority date | — |
| Expiry date | Aug 3, 2040 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG16H15/00
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
The described embodiments relate to systems, methods, and apparatus for providing a multimodal deep memory network (200) capable of generating patient diagnoses (222). The multimodal deep memory network can employ different neural networks, such as a recurrent neural network and a convolution neural network, for creating embeddings (204, 214, 216) from medical images (212) and electronic health records (206). Connections between the input embeddings (204) and diagnoses embeddings (222) can be based on an amount of attention that was given to the images and electronic health records when creating a particular diagnosis. For instance, the amount of attention can be characterized by data (110) that is generated based on sensors that monitor eye movements of clinicians observing the medical images and electronic health records. Resulting patient diagnoses can be provided according to a predetermined classification of weights, or a compilation of words that are generated over multiple iterations of the multimodal deep memory network.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.