Artificial intelligence system for sequence-to-sequence processing with attention adapted for streaming applications
US11810552B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jul 2, 2021 |
| Grant date | Nov 7, 2023 |
| Priority date | — |
| Expiry date | Feb 2, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/048
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
The present disclosure provides an artificial intelligence (AI) system for sequence-to-sequence modeling with attention adapted for streaming applications. The AI system comprises at least one processor; and memory having instructions stored thereon that, when executed by the processor, cause the AI system to process each input frame in a sequence of input frames through layers of a deep neural network (DNN) to produce a sequence of outputs. At least some of the layers of the DNN include a dual self-attention module having a dual non-causal and causal architecture attending to non-causal frames and causal frames. Further, the AI system renders the sequence of outputs.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.