System for dynamic batching at varying granularities using micro-batching to achieve both near real-time and batch processing characteristics
US8978034B1 · kind B1 · utility
67Cited by
6References
22Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Mar 15, 2013 |
| Grant date | Mar 10, 2015 |
| Priority date | — |
| Expiry date | Oct 24, 2033 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/24544
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
This disclosure relates generally to automated workflow for data management, and specifically to efficient data manipulation and information extraction techniques used by a versatile data analytics platform. The information extraction techniques include micro-batching and provenance tracking, as well as integration of provenance-driven policies to improve the efficacy of the analytics. Embodiments disclosed here integrate the concept of real-time or near-real-time data stream processing and event/batch processing into one data processing layer, allowing a single processing definition to be applied at different granularities.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.