Method, apparatus, and device for video frame interpolation
US11354541B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Mar 7, 2019 |
| Grant date | Jun 7, 2022 |
| Priority date | — |
| Expiry date | Mar 7, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2207/20084
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
The present specification discloses a method, apparatus, and device for video frame interpolation. The method of embodiment of the present specification comprises: acquiring a video frame training sample, wherein the video frame training sample includes an even number of consecutive video frames and a first key frame, and the first key frame is an intermediate frame of the even number of consecutive video frames; constructing a pyramid deep learning model, wherein each level of the pyramid deep learning model being used to generate intermediate frames of different resolutions has a plurality of convolutional neural network layers; inputting the even number of consecutive video frames to the pyramid deep learning model to generate a second key frame; modifying the pyramid deep learning model according to the second key frame and the first key frame to generate a modified pyramid deep learning model; inputting a plurality of video frames to be processed into the modified pyramid deep learning model to generate an intermediate frame of the plurality of video frames. The invention fully exploits the spatio-temporal domain information between multi-frame video frames, and adopts a pyram…
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.