Benchmarking machine learning models via performance feedback
US10949252B1 · kind B1 · utility
7Cited by
1References
20Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Feb 13, 2018 |
| Grant date | Mar 16, 2021 |
| Priority date | — |
| Expiry date | Oct 9, 2038 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F11/3452
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Techniques for benchmarking a machine learning model/algorithm are described. For example, in some instances a method includes generating an execution plan for benchmarking of at least one task corresponding to a machine learning model based on an identified machine learning model, identified training data, and at least one objective for the benchmarking job; receiving execution statistics about the execution of the task as a part of the benchmarking job according to the execution plan; and updating the execution plan based at least in part on the received execution statistics of the task.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.