Activity recognition in dark video based on both audio and video content
US11960576B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jul 20, 2021 |
| Grant date | Apr 16, 2024 |
| Priority date | — |
| Expiry date | Jan 15, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L25/27
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Videos captured in low light conditions can be processed in order to identify an activity being performed in the video. The processing may use both the video and audio streams for identifying the activity in the low light video. The video portion is processed to generate a darkness-aware feature which may be used to modulate the features generated from the audio and video features. The audio features may be used to generate a video attention feature and the video features may be used to generate an audio attention feature. The audio and video attention features may also be used in modulating the audio video features. The modulated audio and video features may be used to predict an activity occurring in the video.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.