Synergizing real-time and polling connectors for data ingestion
US10671589B2 · kind B2 · utility
2Cited by
0References
13Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Mar 3, 2017 |
| Grant date | Jun 2, 2020 |
| Priority date | — |
| Expiry date | Aug 29, 2037 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L67/1097
- WIPO fieldDigital communication
- WIPO sectorElectrical engineering
Abstract
A system may utilize a combination of real-time and polling connectors for data crawling. A real-time connector may use a collector to write data associated with a new event from a database to a channel and record external identifiers (IDs) associated the data. A polling connector may use a verifier to compare the recorded IDs with IDs associated with a batch of data, and may write any data of the batch of data to the channel that has not been written previously written by the collector. The system may include an onboarder for reading data previously stored in the database.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.