Layered scene decomposition CODEC with transparency
US11876949B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Apr 6, 2022 |
| Grant date | Jan 16, 2024 |
| Priority date | — |
| Expiry date | Apr 13, 2042 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04N2013/0088
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data including information on transparency of surfaces is divided into a plurality of data layers of increasing depths as the distance between a given layer and the display surface increases. Data layers are sampled using a plenoptic sampling scheme and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.