Hierarchical scale matching and patch estimation for image style transfer with arbitrary resolution
US10769764B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Feb 8, 2019 |
| Grant date | Sep 8, 2020 |
| Priority date | — |
| Expiry date | Feb 8, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2207/20212
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A style of a digital image is transferred to another digital image of arbitrary resolution. A high-resolution (HR) content image is segmented into several low-resolution (LR) patches. The resolution of a style image is matched to have the same resolution as the LR content image patches. Style transfer is then performed on a patch-by-patch basis using, for example, a pair of feature transforms—whitening and coloring. The patch-by-patch style transfer process is then repeated at several increasing resolutions, or scale levels, of both the content and style images. The results of the style transfer at each scale level are incorporated into successive scale levels up to and including the original HR scale. As a result, style transfer can be performed with images having arbitrary resolutions to produce visually pleasing results with good spatial consistency.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.