Confidence threshold determination for machine-learned labeling
US10679390B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Jul 19, 2016 |
| Grant date | Jun 9, 2020 |
| Priority date | — |
| Expiry date | Apr 10, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N5/01
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A map labeling system trains a machine-learned model using a set of training data and generates a set of test predictions for a set of test properties by applying the machine-learned model to a set of testing data. Each prediction in the set of test predictions comprises a confidence score representing the machine-learned model's confidence in the prediction. The map labeling system determines a correctness of each prediction in the set of predictions and determines a relationship between the confidence scores and the correctness of the test predictions. The map labeling system establishes a confidence threshold for the machine-learned model based on the determined relationship and labels a production property by applying the machine-learned model to production data.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.