System, device and method for video frame interpolation using a structured neural network
US10958869B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Nov 14, 2019 |
| Grant date | Mar 23, 2021 |
| Priority date | — |
| Expiry date | Nov 14, 2039 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04N7/0127
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
A system, device and method of video frame interpolation. In one aspect, a frame interpolation system receive candidate interpolated frame and difference data based on a first frame and second frame. It identifies a high-error region and one or more increasingly lower-error regions of the candidate interpolated frame based on the difference data and applies multiple successive stages of a refinement neural network to the regions of the candidate interpolated frame, from highest- to lowest-error. At each stage, the results of the previous stage are combined with the next lower-error region before being refined by the current stage. In some aspects, the system also generates the candidate interpolated frame and the difference data using a flow estimation neural network.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.