Temporal feature alignment network for video inpainting
US11625814B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Mar 4, 2021 |
| Grant date | Apr 11, 2023 |
| Priority date | — |
| Expiry date | May 22, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2207/20084
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Systems and methods are directed to inpainting video. More specifically, initial video data including a sequence of image frames containing missing or corrupted pixel information may be received. Optical flow displacement values and optical flow validity masks may be generated for neighboring image frames of initial video data. Image features from image feature maps of one or more neighboring image frames may be warp-shifted to image feature maps of a current image frame using the optical flow displacement values and warp-shifted image features from the feature maps of the one or more neighboring image frames may be selected based on one or more of the optical flow validity masks. A sequence of complete image frames may be generated based on the selected warp-shifted image features from the feature maps of the one or more neighboring image frames and image features from the image feature maps of the current image frame.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.