Latency prediction method and computing device for the same
US12033052B2 · kind B2 · utility
0Cited by
0References
19Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Aug 11, 2022 |
| Grant date | Jul 9, 2024 |
| Priority date | — |
| Expiry date | Sep 21, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/045
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Provided are a latency prediction method and a computing device for the same. The latency prediction method includes receiving a deep learning model and predicting on-device latency of the received deep learning model using a latency predictor which is trained on the basis of a latency lookup table. The latency lookup table includes information on single neural network layers and latency information of the single neural network layers on an edge device.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.