Systems and methods for failure recovery in at-most-once and exactly-once streaming data processing
US12079087B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jul 22, 2021 |
| Grant date | Sep 3, 2024 |
| Priority date | — |
| Expiry date | Mar 6, 2042 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L2001/0097
- WIPO fieldDigital communication
- WIPO sectorElectrical engineering
Abstract
This patent document describes failure recovery technologies for the processing of streaming data, also referred to as pipelined data. The technologies described herein have particular applicability in distributed computing systems that are required to process streams of data and provide at-most-once and/or exactly-once service levels. In a preferred embodiment, a system comprises many nodes configured in a network topology, such as a hierarchical tree structure. Data is generated at leaf nodes. Intermediate nodes process the streaming data in a pipelined fashion, sending towards the root aggregated or otherwise combined data from the source data streams towards. To reduce overhead and provide locally handled failure recovery, system nodes transfer data using a protocol that controls which node owns the data for purposes of failure recovery as it moves through the network.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.