Clockwork hierarchical variational encoder
US11264010B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Nov 8, 2019 |
| Grant date | Mar 1, 2022 |
| Priority date | — |
| Expiry date | Aug 20, 2040 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L2015/027
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method for providing a frame-based mel spectral representation of speech includes receiving a text utterance having at least one word, and selecting a mel spectral embedding for the text utterance. Each word in the text utterance has at least one syllable and each syllable has at least one phoneme. For each phoneme, using the selected mel spectral embedding, the method also includes: predicting a duration of the corresponding phoneme by encoding linguistic features of the corresponding phoneme with a corresponding syllable embedding for the syllable that includes the corresponding phoneme; and generating a plurality of fixed-length predicted mel-frequency spectrogram frames based on the predicted duration for the corresponding phoneme. Each fixed-length predicted mel-frequency spectrogram frame representing mel-spectral information of the corresponding phoneme.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.