Systems and methods for data quality monitoring
US11829365B2 · kind B2 · utility
Assignee
Inventor
Key dates
| Filing date | May 5, 2022 |
| Grant date | Nov 28, 2023 |
| Priority date | — |
| Expiry date | May 5, 2042 |
Classification
- Technology area (CPC Y)Emerging Cross-Sectional Technologies
- CPC primaryY02P20/143
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Various embodiments include a data monitoring system that monitors the operations of a data pipeline. The data monitoring system receives a call from the data pipeline to ingest unprocessed data. The data monitoring system generates metadata based on the unprocessed data and responsively computes expected data outputs. The data monitoring system receives a call from the data pipeline to ingest processed data that comprises actual data outputs generated by the data pipeline. The data monitoring system generates output metadata based on the processed data. The data monitoring system compares the metadata for the expected data outputs with the output metadata for the actual data outputs and determines when the expected data outputs do not align with the actual data outputs. When the expected data outputs do not align with the actual data outputs, the data monitoring system generates and transfers an alert signifying the non-alignment.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.