Two-level speech prosody transfer
US11514888B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Aug 13, 2020 |
| Grant date | Nov 29, 2022 |
| Priority date | — |
| Expiry date | Feb 4, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L17/18
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method includes receiving an input text utterance to be synthesized into expressive speech having an intended prosody and a target voice and generating, using a first text-to-speech (TTS) model, an intermediate synthesized speech representation tor the input text utterance. The intermediate synthesized speech representation possesses the intended prosody. The method also includes providing the intermediate synthesized speech representation to a second TTS model that includes an encoder portion and a decoder portion. The encoder portion is configured to encode the intermediate synthesized speech representation into an utterance embedding that specifies the intended prosody. The decoder portion is configured to process the input text utterance and the utterance embedding to generate an output audio signal of expressive speech that has the intended prosody specified by the utterance embedding and speaker characteristics of the target voice.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.