Using audio visual correspondence for sound source identification
US11234090B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jan 6, 2020 |
| Grant date | Jan 25, 2022 |
| Priority date | — |
| Expiry date | Jan 6, 2040 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04R2430/20
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
An audio-video correspondence system performs a correspondence analysis between audio and video content. The system obtains video content that includes audio content, the video content comprising a plurality of frames. The system identifies a first set of pixels within the video content associated with changes in pixel values over a first set of frames of the video content. The system subsequently identifies, from the audio content, first audio associated with the first set of frames corresponding to changes in pixel values of the first set of pixels. The system finally assigns the first audio over the first set of frames to the first set of pixels.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.