Machine learning monitoring systems and methods
US11922280B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 9, 2020 |
| Grant date | Mar 5, 2024 |
| Priority date | — |
| Expiry date | Jun 16, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N20/00
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method for monitoring performance of a ML system includes receiving a data stream via a processor and generating a first plurality of metrics based on the data stream. The processor also generates input data based on the data stream, and sends the input data to a machine learning (ML) model for generation of intermediate output and model output based on the input data. The processor also generates a second plurality of metrics based on the intermediate output, and a third plurality of metrics based on the model output. An alert is generated based on at least one of the first plurality of metrics, the second plurality of metrics, or the third plurality of metrics, and a signal representing the alert is sent for display to a user via an interface.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.