Media effects using predicted facial feature locations
US10778939B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Sep 22, 2017 |
| Grant date | Sep 15, 2020 |
| Priority date | — |
| Expiry date | Sep 22, 2037 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06T2210/12
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
An effects application receives a video of a face and detects a bounding box for each frame indicating the location and size of the face in each frame. In one or more reference frames. The application uses an algorithm to determine locations of facial features in the frame. The application then normalizes the feature locations relative to the bounding box and saves the normalized feature locations. In other frames (e.g., target frames), the application obtains the bounding box and then predicts the locations of the facial features based on the size and location of the bounding box and the normalized feature locations calculated in the reference frame. The predicted locations can be made available to an augmented reality function that overlays graphics in a video stream based on face tracking in order to apply a desired effect to the video.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.