Data filtering and optimization for ETL (extract, transform, load) processes
US8744994B2 · kind B2 · utility
6Cited by
5References
20Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Dec 23, 2008 |
| Grant date | Jun 3, 2014 |
| Priority date | — |
| Expiry date | Nov 15, 2030 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/8373
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method and system are disclosed for use with an ETL (Extract, Transform, Load) process, comprising optimizing a filter expression to select a subset of data and evaluating the filter expression on the data after the extracting, before the loading, but not during the transforming of the ETL process. The method and system optimizes the filtering using a pipelined evaluation for single predicate filtering and an adaptive optimization for multiple predicate filtering. The adaptive optimization includes an initial phase and a dynamic phase.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.