Exactly-once performance from a streaming pipeline in a fault-vulnerable system
US11822556B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Aug 10, 2022 |
| Grant date | Nov 21, 2023 |
| Priority date | — |
| Expiry date | Aug 10, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/2456
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Disclosed are embodiments for providing batch performance using a stream processor. In one embodiment, a method is disclosed comprising receiving a stream of events, where each event comprises a header including an event type field and a timestamp. and identifying that the header of a given event in the stream of events includes at least one secondary event in a list of secondary identifiers included in the header. A flag is set in a distributed database for the at least one secondary event, then writing the given event to a table in the distributed database occurs, the table selected based on a respective event type field and timestamp associated with the given event. Deduplicating the given event and the at least one secondary event in response to a close of books (COB) signal occurs, after which writing at least one deduplicated event to a storage device occurs, the at least one deduplicated event selected from the group consisting of the given event and the at least one secondary event.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.