Patent · US Active

Duration informed attention network (DURIAN) for audio-visual synthesis

US11151979B2 · kind B2 · utility

0Cited by
9References
18Claims
0Family size

Assignee

Inventors

Key dates

Filing dateAug 23, 2019
Grant dateOct 19, 2021
Priority date
Expiry dateNov 22, 2039

Classification

  • Technology area (CPC G)Physics
  • CPC primaryG10L2013/105
  • WIPO fieldComputer technology
  • WIPO sectorElectrical engineering

Abstract

A method and apparatus include receiving a text input that includes a sequence of text components. Respective temporal durations of the text components are determined using a duration model. A spectrogram frame is generated based on the duration model. An audio waveform is generated based on the spectrogram frame. Video information is generated based on the audio waveform. The audio waveform is provided as an output along with a corresponding video.

Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.