Using audio cues to improve object retrieval in video
US10108617B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Oct 30, 2013 |
| Grant date | Oct 23, 2018 |
| Priority date | — |
| Expiry date | Jul 24, 2034 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04N5/77
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
A method of object retrieval from visual data is provided that includes annotating at least one portion of the visual data with a context keyword corresponding to an object, wherein the annotating is performed responsive to recognition of the context keyword in audio data corresponding to the at least one portion of the visual data, receiving a query to retrieve the object, wherein the query includes a query keyword associated with both the object and the context keyword, identifying the at least one portion of the visual data based on the context keyword, and searching for the object in the at least one portion of the visual data using an appearance model corresponding to the query keyword.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.