Cascaded architecture for disparity and motion prediction with block matching and convolutional neural network (CNN)
US11694341B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 23, 2019 |
| Grant date | Jul 4, 2023 |
| Priority date | — |
| Expiry date | Feb 6, 2041 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04N2013/0085
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
A CNN operates on the disparity or motion outputs of a block matching hardware module, such as a DMPAC module, to produce refined disparity or motion streams which improve operations in images having ambiguous regions. As the block matching hardware module provides most of the processing, the CNN can be small and thus able to operate in real time, in contrast to CNNs which are performing all of the processing. In one example, the CNN operation is performed only if the block hardware module output confidence level is below a predetermined amount. The CNN can have a number of different configurations and still be sufficiently small to operate in real time on conventional platforms.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.