Hardware efficient automatic speech recognition
US12334075B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Oct 14, 2022 |
| Grant date | Jun 17, 2025 |
| Priority date | — |
| Expiry date | Sep 1, 2043 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L15/30
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Modern automatic speech recognition (ASR) systems can utilize artificial intelligence (AI) models to service ASR requests. The number and scale of AI models used in a modern ASR system can be substantial. The process of configuring and reconfiguring hardware to execute various AI models corresponding to a substantial number of ASR requests can be time consuming and inefficient. Among other features, the described technology utilizes batching of ASR requests, splitting of the ASR requests, and/or parallel processing to efficiently use hardware tasked with executing AI models corresponding to ASR requests. In one embodiment, the compute graphs of ASR tasks are used to batch the ASR requests. The corresponding AI models of each batch can be loaded into hardware, and batches can be processed in parallel. In some embodiments, the ASR requests are split, batched, and processed in parallel.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.