Layer-wise scheduling on models based on idle times
US12099869B2 · kind B2 · utility
0Cited by
8References
21Claims
0Family size
Assignees
Inventors
Key dates
| Filing date | Mar 9, 2021 |
| Grant date | Sep 24, 2024 |
| Priority date | — |
| Expiry date | Jan 2, 2043 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F9/505
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A scheduler, a method of operating the scheduler, and an electronic device including the scheduler are disclosed. The method of operating the scheduler configured to determine a model to be executed in an accelerator includes receiving one or more requests for execution of a plurality of models to be independently executed in the accelerator, and performing layer-wise scheduling on the models based on an idle time occurring when a candidate layer which is a target for the scheduling in each of the models is executed in the accelerator.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.