Execution-time dynamic range partitioning transformations
US11423049B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | May 11, 2020 |
| Grant date | Aug 23, 2022 |
| Priority date | — |
| Expiry date | Jul 12, 2040 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/24554
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method for execution-time dynamic range partitioning includes receiving user data including a partitioning key and a clustering key. The user data includes a respective number of total rows defining a total data size for the user data. The method also includes identifying storage constraints for the data storage system. The storage constraints include a target file size and a target number of rows per file. The method further includes determining a plurality of split points for the user data based on the storage constraints. The method also includes generating partitioning quantiles from the plurality of split points that define a range between each split point of the plurality of split points. The method further includes range partitioning each row of the user data into files using the partitioning quantiles.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.