Video frame interpolation using a convolutional neural network
US10491856B2 · kind B2 · utility
Assignees
Inventors
Key dates
| Filing date | May 8, 2018 |
| Grant date | Nov 26, 2019 |
| Priority date | — |
| Expiry date | May 8, 2038 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T5/70
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
According to one implementation, a video processing system includes a computing platform having a hardware processor and a system memory storing a frame interpolation software code, the frame interpolation software code including a convolutional neural network (CNN) trained using a loss function having an image loss term summed with a phase loss term. The hardware processor executes the frame interpolation software code to receive first and second consecutive video frames including respective first and second images, and to decompose the first and second images to produce respective first and second image decompositions. The hardware processor further executes the frame interpolation software code to use the CNN to determine an intermediate image decomposition corresponding to an interpolated video frame for insertion between the first and second video frames based on the first and second image decompositions, and to synthesize the interpolated video frame based on the intermediate image decomposition.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.