Parallel compression of data chunks of a shared data object using a log-structured file system
US9477682B1 · kind B1 · utility
Assignees
Inventors
Key dates
| Filing date | Mar 13, 2013 |
| Grant date | Oct 25, 2016 |
| Priority date | — |
| Expiry date | Apr 26, 2034 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L69/04
- WIPO fieldDigital communication
- WIPO sectorElectrical engineering
Abstract
Techniques are provided for parallel compression of data chunks being written to a shared object. A client executing on a compute node or a burst buffer node in a parallel computing system stores a data chunk generated by the parallel computing system to a shared data object on a storage node by compressing the data chunk; and providing the data compressed data chunk to the storage node that stores the shared object. The client and storage node may employ Log-Structured File techniques. The compressed data chunk can be de-compressed by the client when the data chunk is read. A storage node stores a data chunk as part of a shared object by receiving a compressed version of the data chunk from a compute node; and storing the compressed version of the data chunk to the shared data object on the storage node.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.