Techniques for improving storage space efficiency with variable compression size unit
US10452616B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Oct 29, 2018 |
| Grant date | Oct 22, 2019 |
| Priority date | — |
| Expiry date | Oct 29, 2038 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/1752
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Techniques for data processing a data set may comprise: performing first processing that forms a first compression unit, wherein the first compression unit includes a data chunks including a first data chunk having a first entropy value less than an entropy threshold, the first processing including: receiving a second data chunk; determining, in accordance with criteria, whether to add the second data chunk to the first compression unit; and responsive to determining to add the second data chunk to the first compression unit, adding the second data chunk to the first compression unit; and compressing the first compression unit as a single compressible unit. The second chunk may be added if its entropy value is less than the entropy threshold and if entropy values of the first and second chunks are similar. The second chunk may be added if the resulting compression unit provides sufficient storage/compression benefit.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.