Dynamic partitioning techniques for data streams
US9720989B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Nov 11, 2013 |
| Grant date | Aug 1, 2017 |
| Priority date | — |
| Expiry date | Dec 6, 2034 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/00
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A partitioning policy, comprising an indication of an initial mapping of data records of a stream to a plurality of partitions, is selected to distribute data records of a data stream among a plurality of nodes of a stream management service. Data ingestion nodes and storage nodes are configured according to the initial mapping. In response to a determination that a triggering criterion for dynamically repartitioning the data stream has been met, a modified mapping is generated, and a different set of ingestion and storage nodes are configured. For at least some time during which arriving data records are stored in accordance with the modified mapping, data records stored at the first set of storage nodes in accordance with the initial mapping are retained.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.