System and method for visual analysis of emotional coherence in videos
US11282297B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Sep 2, 2020 |
| Grant date | Mar 22, 2022 |
| Priority date | — |
| Expiry date | Oct 24, 2040 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04N23/611
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
A computer implemented method and system processing a video signal. The method comprises comprising the steps of: detecting a human face displayed in the video signal and extracting physiological, biological, or behavior state information from the displayed face at a first level of granularity of the video signal; processing any two or more of: (i) a script derived from or associated with the video signal to extract language tone information from said script at a first level of granularity of the script; (ii) an audio signal derived from or associated with the video signal to derive behavior state information from said audio signal at a first level of granularity of the audio signal; (iii) a video image derived from the video signal to detect one or more human gestures of the person whose face is displayed in the video signal; and merging said physiological, biological, or behavior state information extracted from the displayed face in the video signal with any two or more of: (i) the language tone information extracted from the script; (ii) the behavior state information derived from the audio signal; and (iii) and the one or more human gestures derived from the video image, where…
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.