Stream-based data deduplication with cache synchronization
US9451000B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 24, 2013 |
| Grant date | Sep 20, 2016 |
| Priority date | — |
| Expiry date | Apr 2, 2034 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L67/5681
- WIPO fieldDigital communication
- WIPO sectorElectrical engineering
Abstract
Stream-based data deduplication is provided in a multi-tenant shared infrastructure but without requiring “paired” endpoints having synchronized data dictionaries. Data objects processed by the dedupe functionality are treated as objects that can be fetched as needed. As such, a decoding peer does not need to maintain a symmetric library for the origin. Rather, if the peer does not have the chunks in cache that it needs, it follows a conventional content delivery network procedure to retrieve them. In this way, if dictionaries between pairs of sending and receiving peers are out-of-sync, relevant sections are then re-synchronized on-demand. The approach does not require that libraries maintained at a particular pair of sender and receiving peers are the same. Rather, the technique enables a peer, in effect, to “backfill” its dictionary on-the-fly. On-the-wire compression techniques are provided to reduce the amount of data transmitted between the peers.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.