Multimodal machine learning for emotion metrics
US10628741B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Sep 11, 2018 |
| Grant date | Apr 21, 2020 |
| Priority date | — |
| Expiry date | Sep 11, 2038 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L25/63
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Techniques are described for machine-trained analysis for multimodal machine learning. A computing device captures a plurality of information channels, wherein the plurality of information channels includes contemporaneous audio information and video information from an individual. A multilayered convolutional computing system learns trained weights using the audio information and the video information from the plurality of information channels, wherein the trained weights cover both the audio information and the video information and are trained simultaneously, and wherein the learning facilitates emotional analysis of the audio information and the video information. A second computing device captures further information and analyzes the further information using trained weights to provide an emotion metric based on the further information. Additional information is collected with the plurality of information channels from a second individual and learning the trained weights factors in the additional information. The further information can include only video data or audio data.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.