Emitting word timings with end-to-end models
US11580956B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Mar 17, 2021 |
| Grant date | Feb 14, 2023 |
| Priority date | — |
| Expiry date | Apr 30, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L25/87
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method includes receiving a training example that includes audio data representing a spoken utterance and a ground truth transcription. For each word in the spoken utterance, the method also includes inserting a placeholder symbol before the respective word identifying a respective ground truth alignment for a beginning and an end of the respective word, determining a beginning word piece and an ending word piece, and generating a first constrained alignment for the beginning word piece and a second constrained alignment for the ending word piece. The first constrained alignment is aligned with the ground truth alignment for the beginning of the respective word and the second constrained alignment is aligned with the ground truth alignment for the ending of the respective word. The method also includes constraining an attention head of a second pass decoder by applying the first and second constrained alignments.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.