Parallel prefetching log/meta stream sub-portions to recreate partition states in a distributed computing system
US10609174B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Apr 11, 2017 |
| Grant date | Mar 31, 2020 |
| Priority date | — |
| Expiry date | Jun 26, 2038 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L67/5681
- WIPO fieldDigital communication
- WIPO sectorElectrical engineering
Abstract
Prefetching metadata stream sub-portions and/or log stream sub-portions to recreate partition states in a distributed computing system. A system monitors performance metrics associated with a first node running an instance of a partition and, based thereon, cause a second node to duplicate a desired operational state of the partition. The desired operational state may result from transactions being performed on the partition after a previous operational state. Re-creating the desired operational state may include causing multiple prefetch buffers to simultaneously load sub-portions of the transactions and then commencing a replay operation after an initial subset of the transactions is loaded but prior to the entirety of the transactions being fully loaded. The system may preemptively analyze individual prefetch buffers to identify partial buffers that have not fully loaded. Then, the system may cause other prefetch buffers to assist the partial buffers in fully loading a corresponding subset of transactions.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.