Method for audio synthesis adapted to video characteristics
US10923106B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jan 24, 2019 |
| Grant date | Feb 16, 2021 |
| Priority date | — |
| Expiry date | May 25, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L13/033
- WIPO fieldAudio-visual technology
- WIPO sectorElectrical engineering
Abstract
An audio synthesis method adapted to video characteristics is provided. The audio synthesis method according to an embodiment includes: extracting characteristics x from a video in a time-series way; extracting characteristics p of phonemes from a text; and generating an audio spectrum characteristic St used to generate an audio to be synthesized with a video at a time t, based on correlations between an audio spectrum characteristic St-1, which is used to generate an audio to be synthesized with a video at a time t−1, and the characteristics x. Accordingly, an audio can be synthesized according to video characteristics, and speech according to a video can be easily added.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.