Image hole filling that accounts for global structure and local texture
US10290085B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 14, 2016 |
| Grant date | May 14, 2019 |
| Priority date | — |
| Expiry date | Mar 30, 2037 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2207/20084
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Image hole filling that account for global structure and local texture. One exemplary technique involves using both a content neural network and a texture neural network. The content neural network is trained to encode image features based on non-hole image portions and decode the image features to fill holes. The texture neural network is trained to extract image patch features that represent texture. The exemplary technique receives an input image that has a hole and uses the two neural networks to fill the hole and provide a result image. This is accomplished by selecting pixel values for the hole based on a content constraint that uses the content neural network to account for global structure and a texture constraint that uses the texture neural network to account for local texture. For example, the pixel values can be selected by optimizing a loss function that implements the constraints.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.