System and method for fast parallel data processing in distributed storage systems
US10216740B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Mar 31, 2016 |
| Grant date | Feb 26, 2019 |
| Priority date | — |
| Expiry date | Apr 29, 2037 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH03M13/3761
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A system and method is disclosed for fast parallel data processing in a distributed storage system. An example method includes receiving at least one digital object; determining, by a processor of a computing device, whether the at least one digital object has a fixed data block structure; in response to determining that the at least one digital object has a fixed data block structure, determining by the processor a size of each fixed data block of the at least one digital object; determining a number of archive chunks for storing the at least one digital object on a selected plurality of storage servers based at least upon the size of each fixed data block; and partitioning the at least one digital object into the number of archive chunks for storing on the selected plurality of storage servers using erasure coding.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.