Face-based frame rate upsampling for video calls
US11869274B2 · kind B2 · utility
Assignee
Inventor
Key dates
| Filing date | Mar 29, 2022 |
| Grant date | Jan 9, 2024 |
| Priority date | — |
| Expiry date | Mar 29, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2207/30201
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
A method includes receiving a set of video frames that correspond to a video, including a first video frame and a second video frame that each include a face, wherein the second video frame is subsequent to the first video frame. The method further includes performing face tracking on the first video frame to identify a first face resampling keyframe and performing face tracking on the second video frame to identify a second face resampling keyframe. The method further includes deriving an interpolation amount. The method further includes determining a first interpolated face frame based on the first face resampling keyframe and the interpolation amount. The method further includes determining a second interpolated face frame based on the second face resampling keyframe and the interpolation amount. The method further includes rendering an interpolated first face and an interpolated second face. The method further includes displaying a final frame.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.