Smart color-based background replacement

US11076111B1 · kind B1 · utility

Assignee

• Twitch Interactive, Inc. · US

Inventors

• Kevin M. Ni · San Francisco, US
• Jackson J. Gardner · San Jose, US
• Charles Bradford · Irvine, US
• Sean Stanek · West Des Moines, US
• Ross Gardner, Jr. · Irvine, US
• Tyler McDowall · Irvine, US
• Phillip Carter · Lake Forest, US
• Furqan Rydhan · San Francisco, US
• Florian Nierhaus · Munich, DE
• Sang Jin Lee · Suneung-ri, KR

Key dates

• Filing date: Nov 13, 2019
• Grant date: Jul 27, 2021
• Expiry date: Nov 13, 2039

Classification

• Technology area (CPC G): Physics
• CPC primary: G06T2207/20072
• WIPO field: Audio-visual technology
• WIPO sector: Electrical engineering

Abstract

A streaming application setup assistant may receive an image captured by a camera, the image capturing a physical environment that is to be part of a live video stream. A plurality of pixels may be selected from the image. The plurality of pixels may be grouped, based on a pixel color value for each pixel, into a plurality of pixel groups. A key pixel color value may be calculated that is associated with an average pixel color value of pixels in a largest pixel group of the plurality of pixel groups. A similarity color range that encompasses a threshold percentage of the pixels in the largest pixel group may be identified based on the key pixel color value. The similarity color range may be utilized to configure settings for replacement of the background in the live video stream.