Duplicate filtering in a data processing environment
US8180739B2 · kind B2 · utility
1Cited by
5References
20Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Jul 27, 2009 |
| Grant date | May 15, 2012 |
| Priority date | — |
| Expiry date | Jul 22, 2030 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/24568
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A data processing method is provided. The method comprises collecting a stream of data records from one or more devices in a network; loading one or more persistent indexes associated with the stream of data records into memory; identifying duplicate data records in the stream of data records using the in-memory indexes; and updating a repository such that the duplicate data records are not stored in the repository or managed differently than non-duplicate data records.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.