Techniques for compression and processing optimizations by using data transformations
US8239421B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Aug 30, 2010 |
| Grant date | Aug 7, 2012 |
| Priority date | — |
| Expiry date | Dec 30, 2030 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH03M7/3084
- WIPO fieldBasic communication processes
- WIPO sectorElectrical engineering
Abstract
Described herein are compression and processing optimizations by using data transformation techniques. In example embodiments, a byte-wise differential transformation is applied to columnar data represented as a list of length-value pairs to determine a list of delta pairs that is subsequently compressed and stored on persistent storage. A length separation transformation is applied to separate a list of length-value pairs into a length array and a corresponding data value array, where these two arrays are subsequently compressed and stored separately on persistent storage. A native number transformation is applied to a set of number values to remove the lengths stored in the number values, where the transformed set is stored on persistent storage instead of the original set of number values. A native datetime-type transformation is applied to a set of datetime values to generate an encoding that is used to encode the set of datetime values into an encoded set that is stored on persistent storage instead of the original set.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.