Mouth shape correction model, and model training and application method
US11887403B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Jun 21, 2023 |
| Grant date | Jan 30, 2024 |
| Priority date | — |
| Expiry date | Jun 21, 2043 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06V20/46
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Embodiments of this disclosure provide a mouth shape correction model, and model training and application methods. The model includes a mouth feature extraction module, a key point extraction module, a first video module, a second video module, and a discriminator. The training method includes: based on a first original video and a second original video, extracting corresponding features by using various modules in the model to train the model; and when the model meets a convergence condition, completing the training to generate a target mouth shape correction model. The application method includes: inputting a video in which a mouth shape of a digital-human actor is to be corrected and corresponding audio into a mouth shape correction model, to obtain a video in which the mouth shape of the digital-human actor in the video is corrected, wherein the mouth shape correction model is a model trained by using the training method.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.