Retiming digital videos utilizing deep learning
US12112771B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Mar 16, 2023 |
| Grant date | Oct 8, 2024 |
| Priority date | — |
| Expiry date | Apr 11, 2043 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04N21/2402
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
This disclosure describes one or more implementations of systems, non-transitory computer-readable media, and methods that generate a temporally remapped video that satisfies a desired target duration while preserving natural video dynamics. In certain instances, the disclosed systems utilize a playback speed prediction machine-learning model that recognizes and localizes temporally varying changes in video playback speed to re-time a digital video with varying frame-change speeds. For instance, to re-time the digital video, the disclosed systems utilize the playback speed prediction machine-learning model to infer the slowness of individual video frames. Subsequently, in certain embodiments, the disclosed systems determine, from frames of a digital video, a temporal frame sub-sampling that is consistent with the slowness predictions and fit within a target video duration. In certain implementations, the disclosed systems utilize the temporal frame sub-sampling to generate a speed varying digital video that preserves natural video dynamics while fitting the target video duration.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.