Back-off language model compression
US8725509B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Jun 17, 2009 |
| Grant date | May 13, 2014 |
| Priority date | — |
| Expiry date | Jun 18, 2032 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F40/284
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to language models stored for digital language processing. In one aspect, a method includes the actions of generating a language model, including: receiving a collection of n-grams from a corpus, each n-gram of the collection having a corresponding first probability of occurring in the corpus, and generating a trie representing the collection of n-grams, the trie being represented using one or more arrays of integers, and compressing an array representation of the trie using block encoding; and using the language model to identify a second probability of a particular string of words occurring.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.