Method and apparatus for the use of cross modal association to isolate individual media sources
US8660841B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Apr 6, 2008 |
| Grant date | Feb 25, 2014 |
| Priority date | — |
| Expiry date | May 31, 2028 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10H2220/455
- WIPO fieldOther consumer goods
- WIPO sectorOther fields
Abstract
Apparatus for isolation of a media stream of a first modality from a complex media source having at least two media modality, and multiple objects, and events, comprises: recording devices for the different modalities; an associator for associating between events recorded in said first modality and events recorded in said second modality, and providing an association output; and an isolator that uses the association output for isolating those events in the first mode correlating with events in the second mode associated with a predetermined object, thereby to isolate a isolated media stream associated with said predetermined object. Thus it is possible to identify events such as hand or mouth movements, and associate these with sounds, and then produce a filtered track of only those sounds associated with the events. In this way a particular speaker or musical instrument can be isolated from a complex scene.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.