Methods, systems, and media for swapping faces in images

US8712189B2 · kind B2 · utility

Assignee

• The Trustees of Columbia University in the City of New York · US

Inventors

• Dimitri Bitouk · Daly City, US
• Neeraj Kumar · Agra, IN
• Peter N. Belhumeur · New York, US
• Shree K. Nayar · New York, US

Key dates

• Filing date: May 29, 2013
• Grant date: Apr 29, 2014
• Expiry date: May 29, 2033

Classification

• Technology area (CPC G): Physics
• CPC primary: G06T11/60
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

Methods, systems, and media for swapping faces in images are provided. In some embodiments, a detected face and face data corresponding to an input image is received. A pose bin associated with the detected face is then identified based on the face data. Next, the detected face is aligned to a generic face associated with the pose bin. At least a portion of a candidate face associated with the pose bin is selected. The at least a portion of the candidate face is then copied to a copy of the input image that is aligned with the generic image to form a swapped-face image. The swapped-face image is next aligned to the input image to form an output image, and then the output image is outputted to a display.