Cooperative storage of shared files in a parallel computing system with dynamic block size
US9183211B1 · kind B1 · utility
Assignees
Inventors
Key dates
| Filing date | Dec 28, 2012 |
| Grant date | Nov 10, 2015 |
| Priority date | — |
| Expiry date | Jan 12, 2033 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/13
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Improved techniques are provided for parallel writing of data to a shared object in a parallel computing system. A method is provided for storing data generated by a plurality of parallel processes to a shared object in a parallel computing system. The method is performed by at least one of the processes and comprises: dynamically determining a block size for storing the data; exchanging a determined amount of the data with at least one additional process to achieve a block of the data having the dynamically determined block size; and writing the block of the data having the dynamically determined block size to a file system. The determined block size comprises, e.g., a total amount of the data to be stored divided by the number of parallel processes. The file system comprises, for example, a log structured virtual parallel file system, such as a Parallel Log-Structured File System (PLFS).
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.