Using a data store and message queue to ingest data for a data intake and query system
US11615082B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Jul 31, 2020 |
| Grant date | Mar 28, 2023 |
| Priority date | — |
| Expiry date | Nov 22, 2040 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L43/20
- WIPO fieldDigital communication
- WIPO sectorElectrical engineering
Abstract
A data intake and query system can ingest and index large amounts of data using one or more ingestors and indexers. The ingestors can ingest incoming data and use it to generate events. The ingestor can group the events and prepare them for communication to a message bus. The ingestor can determine a size of the group of events. If the size of the group of events satisfies a message size threshold, the ingestor can store the group of events to a data store, obtain a reference to the group of events, and communicate the reference to the group of events to a message queue. An indexer can obtained the reference from the message queue and use the reference to obtain the group of events from the data store.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.