Heartbeat propagation in a distributed stream processing system
US10902000B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Sep 4, 2018 |
| Grant date | Jan 26, 2021 |
| Priority date | — |
| Expiry date | Apr 27, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/2471
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
An event processing system for distributing a continuous query, and processing events in an event stream, is disclosed. The system can synchronize timestamps across all partitions by adding a heartbeat propagator component propagating a heartbeat signal for silent partitions. The system can further include a timestamp tracker component that tracks the maximum observed timestamp across all partitions for each batch, and sends this to each partition. The system can distribute partitions of the events to the worker nodes, and instruct a heartbeat propagator component to generate a heartbeat for a first worker node corresponding to an event in a different partition. The system receives outputs from the worker nodes and combines these into a single result corresponding to a continuous query. The system can further implement a timestamp tracker to select a highest timestamp value of a previous batch, and send the value to the worker nodes.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.