Composite scalable video streaming

US10623753B2 · kind B2 · utility

Assignee

• Fraunhofer-Gesellschaft zur förderung der angewandten Forschung e.V. · DE

Inventors

• Robert SKUPIN · Berlin, DE
• Yago SÁNCHEZ DE LA FUENTE · Berlin, DE
• Thomas SCHIERL · Berlin, DE

Key dates

• Filing date: Nov 10, 2017
• Grant date: Apr 14, 2020
• Expiry date: Nov 10, 2037

Classification

• Technology area (CPC H): Electricity
• CPC primary: H04N19/51
• WIPO field: Audio-visual technology
• WIPO sector: Electrical engineering

Abstract

Video streaming concepts are presented. In a first aspect, the video stream is formed as a multi-layered data stream with forming a set of one or more layers of the multi-layered data stream by copying from the coded version of the video content, while a composition of the at least one video is synthesized in at least a portion of pictures of a predetermined layer of the multi-layer data stream by means of inter-layer prediction. In a second aspect, inter-layer prediction is used to either substitute otherwise missing referenced pictures of a newly encompassed video by inserting replacement pictures, or portions of the newly encompassed video referencing, by motion-compensated prediction, pictures which are missing are replaced by inter-layer prediction. In a third aspect, output pictures inserted into the composed video stream so as to synthesize the composition of the video content by copying from a no-output portion of the composed data stream by temporal prediction, are inserted into the composed data stream so that output pictures are arranged in the data stream in the presentation time order rather than the coded picture order.