Real-time tracking-compensated image effects

US11645843B2 · kind B2 · utility

Assignee

• SNAP INC. · US

Inventors

• Samuel Edward Hare · Los Angeles, US
• Fedir Poliakov · Odesa, UA
• Guohui Wang · Los Angeles, US
• Xuehan Xiong · Pittsburgh, US
• Jianchao Yang · Santa Monica, US
• Linjie Yang · Los Angeles, US
• Shah Tanmay Anilkumar · Los Angeles, US

Key dates

• Filing date: Jan 22, 2021
• Grant date: May 9, 2023
• Expiry date: Jul 12, 2041

Classification

• Technology area (CPC —): General

Abstract

A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.