Systems and methods detecting and mitigating anomalous shifts in a machine learning model
US10462172B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | May 16, 2019 |
| Grant date | Oct 29, 2019 |
| Priority date | — |
| Expiry date | May 16, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N7/01
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Systems and methods include implementing a remote machine learning service that collects digital event data; collecting incumbent digital threat scores generated by an incumbent machine learning model and successor digital threat scores generated by a successor digital threat machine learning (ML) model; implementing anomalous-shift-detection that detects whether the successor digital threat scores of the successor digital threat ML model produces an anomalous shift; if the anomalous shift is detected by the machine learning model validation system, blocking a deployment of the successor digital threat model to a live ensemble of digital threat scoring models; or if the anomalous shift is not detected by the machine learning model validation system, deploying the successor digital threat ML model by replacing the incumbent digital threat ML model in a live ensemble of digital threat scoring models with the successor digital threat ML model.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.