Data deduplication for eventual consistency system and method
US10795891B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jul 11, 2017 |
| Grant date | Oct 6, 2020 |
| Priority date | — |
| Expiry date | Jan 27, 2039 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L67/1097
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
The present invention relates to a system and method for improving data deduplication for eventual consistent for distributed storage systems. Eventual consistency poses significant challenges for deduplication systems. This is because data storage is often spread over many different notes and up-to-date data may not always be available. A significant component of deduplication is creating pointers to older copies of identical data and deleting the later copy. In a basic implementation, this creates an eventually consistent vulnerability. If an older copy of the pointers to the data is retrieved (in the form of a metadata file), it may be pointing to a copy of the data that is no longer available. The present system and method solves the problem with eventual consistency vulnerabilities by introducing a level of indirection and creating manifest files for each file (vessel).
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.