Music driven human dancing video synthesis
US10825221B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Apr 23, 2019 |
| Grant date | Nov 3, 2020 |
| Priority date | — |
| Expiry date | Apr 23, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10H2250/311
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
The present disclosure provides a method for generating a video of a body moving in synchronization with music by applying a first artificial neural network (ANN) to a sequence of samples of an audio waveform of the music to generate a first latent vector describing the waveform and a sequence of coordinates of points of body parts of the body, by applying a first stage of a second ANN to the sequence of coordinates to generate a second latent vector describing movement of the body, by applying a second stage of the second ANN to static images of a person in a plurality of different poses to generate a third latent vector describing an appearance of the person, and by applying a third stage of the second ANN to the first latent vector, the second latent vector, and the third latent vector to generate the video.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.