Dynamic scheduling of tasks for collecting and processing data from external sources
US8978036B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jul 29, 2013 |
| Grant date | Mar 10, 2015 |
| Priority date | — |
| Expiry date | Jul 29, 2033 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F9/505
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A scheduler manages execution of a plurality of data-collection jobs, assigns individual jobs to specific forwarders in a set of forwarders, and generates and transmits tokens (e.g., pairs of data-collection tasks and target sources) to assigned forwarders. The forwarder uses the tokens, along with stored information applicable across jobs, to collect data from the target source and forward it onto an indexer for processing. For example, the indexer can then break a data stream into discrete events, extract a timestamp from each event and index (e.g., store) the event based on the timestamp. The scheduler can monitor forwarders' job performance, such that it can use the performance to influence subsequent job assignments. Thus, data-collection jobs can be efficiently assigned to and executed by a group of forwarders, where the group can potentially be diverse and dynamic in size.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.