Data compression using dictionary encoding

US8933829B2 · kind B2 · utility

Assignee

• International Business Machines Corporation · US

Inventors

• Felix Beier · Haigerloch, DE
• Carlos J. Caballero Grolimund · Stuttgart, DE
• Vijayshankar Raman · Sunnyvale, US
• Knut Stolze · Jena, DE

Key dates

• Filing date: Sep 23, 2013
• Grant date: Jan 13, 2015
• Expiry date: Sep 23, 2033

Classification

• Technology area (CPC H): Electricity
• CPC primary: H03M7/6023
• WIPO field: Basic communication processes
• WIPO sector: Electrical engineering

Abstract

Embodiments relate to data compression using dictionary encoding. An aspect includes subdividing a table of uncompressed data into a first block and a second block of complete rows. Another aspect includes determining information about a frequency of occurrence of different values for each column of the first block. Another aspect includes selecting a row of the first block to be removed out of the first block using frequency of occurrence-information. Another aspect includes removing the a row out of the first block to form an updated first block and determining information about a frequency of occurrence of different values for each column of the updated first block. Another aspect includes deriving a dictionary containing code-words for encoding the values of the updated first block. Another aspect includes encoding the values of the updated first block based on the code-words. Another aspect includes adding the removed row to the second block.