Partition-based index management in hadoop-like data stores
US9460147B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Jan 12, 2016 |
| Grant date | Oct 4, 2016 |
| Priority date | — |
| Expiry date | Jan 12, 2036 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/901
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method for processing a dataset in a partitioned distributed storage system having data stored in a base table and an index stored in an index table, may include receiving base and index table metadata from the partitioned distributed storage system, where the base and index table metadata includes respective table partition information. The method may further include partitioning the dataset into a set of base-delta files according to the base table metadata, and generating a set of index-delta files corresponding with the base-delta files according to the index table metadata. The method may additionally include updating the partitioned distributed storage system with the set of base-delta and the set of index-delta files, where a first update of the base table is synchronous with a second update of the index table.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.