Universal lexical analyzers
US10169324B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 8, 2016 |
| Grant date | Jan 1, 2019 |
| Priority date | — |
| Expiry date | Dec 8, 2036 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F8/425
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
An example lexical analysis system may include lexical analyzer instructions and training instructions. The lexical analyzer instructions, when executed, may form a universal lexical analyzer that is to lexically analyze an input program by evaluating a function that maps an input tuple of lexemes to an output tuple of tokens based on input probability parameters. The universal lexical analyzer may be configurable for any programming language by inputting a set of probability parameters for the respective programming language as the input probability parameters of the function. The training instructions, when executed, may generate a set of probability parameters for any programming language by: receiving training programs that are in the respective programming language, each comprising a tuple of lexemes with associated tokens, and determining the set of probability parameters for the respective programming language based on lexemes and tokens in the training programs that are in the respective programming language.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.