Contrastive Siamese network for semi-supervised speech recognition
US12334059B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Mar 28, 2024 |
| Grant date | Jun 17, 2025 |
| Priority date | — |
| Expiry date | Mar 28, 2044 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L15/1815
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method includes receiving a plurality of unlabeled audio samples corresponding to spoken utterances not paired with corresponding transcriptions. At a target branch of a contrastive Siamese network, the method also includes generating a sequence of encoder outputs for the plurality of unlabeled audio samples and modifying time characteristics of the encoder outputs to generate a sequence of target branch outputs. At an augmentation branch of a contrastive Siamese network, the method also includes performing augmentation on the unlabeled audio samples, generating a sequence of augmented encoder outputs for the augmented unlabeled audio samples, and generating predictions of the sequence of target branch outputs generated at the target branch. The method also includes determining an unsupervised loss term based on target branch outputs and predictions of the sequence of target branch outputs. The method also includes updating parameters of the audio encoder based on the unsupervised loss term.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.