Video concept classification using audio-visual atoms
US8135221B2 · kind B2 · utility
Assignees
Inventors
Key dates
| Filing date | Oct 7, 2009 |
| Grant date | Mar 13, 2012 |
| Priority date | — |
| Expiry date | Sep 10, 2030 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L25/00
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method for determining a classification for a video segment, comprising the steps of: breaking the video segment into a plurality of short-term video slices, each including a plurality of video frames and an audio signal; analyzing the video frames for each short-term video slice to form a plurality of region tracks; analyzing each region track to form a visual feature vector and a motion feature vector; analyzing the audio signal for each short-term video slice to determine an audio feature vector; forming a plurality of short-term audio-visual atoms for each short-term video slice by combining the visual feature vector and the motion feature vector for a particular region track with the corresponding audio feature vector; and using a classifier to determine a classification for the video segment responsive to the short-term audio-visual atoms.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.