Global distributed file append using log-structured file system
US10262000B1 · kind B1 · utility
Assignees
Inventors
Key dates
| Filing date | Jun 19, 2013 |
| Grant date | Apr 16, 2019 |
| Priority date | — |
| Expiry date | Oct 25, 2035 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/11
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Techniques are provided for globally appending data from a group of distributed processes to a shared file using a log-structured file system. Data generated by a plurality of processes in a parallel computing system are appended to a shared file by storing the data to the shared file using a log-structured file system (such as a Parallel Log-Structured File System (PLFS)); and generating an index entry for the data, the index entry comprising a logical offset entry and a timestamp entry indicating a time of the storage, wherein the logical offset entry is resolved at read time. The logical offset entry can be populated with an append placeholder that is resolved when the shared file is read. At read time, a plurality of the index entries associated with the shared file can be sorted using the timestamp entry to deliver the requested shared file to a requesting application.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.