ETL data transit method and system
US9244987B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | May 31, 2012 |
| Grant date | Jan 26, 2016 |
| Priority date | — |
| Expiry date | May 1, 2034 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/254
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method and system for archiving data is provided. The method includes an extraction stage, a load stage, and a production merge stage. In the extraction stage, incoming files from a source system are extracted, where each incoming file has data records. Upon determining that the incoming files are of different data record types, the incoming files are split by record type. The files are also parsed. In a load stage, all files from a load ready directory are placed together in a single batch with a common RUNID for each data record type. In a production merge stage, all files made available from the load stage are processed. The processed files are loaded into a data warehouse. Each stage operates independently of any other stage. Each stage is also iterative and circular.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.