Automatic recognition of visual and audio-visual cues
US12125317B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 1, 2021 |
| Grant date | Oct 22, 2024 |
| Priority date | — |
| Expiry date | May 17, 2043 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N20/10
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method for detecting a cue (e.g., a visual cue or a visual cue combined with an audible cue) occurring together in an input video includes: presenting a user interface to record an example video of a user performing an act including the cue; determining a part of the example video where the cue occurs; applying a feature of the part to a neural network to generate a positive embedding; dividing the input video into a plurality of chunks and applying a feature of each chunk to the neural network to generate a plurality of negative embeddings; applying a feature of a given one of the chunks to the neural network to output a query embedding; and determining whether the cue occurs in the input video from the query embedding, the positive embedding, and the negative embeddings.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.