Stream processing at scale
US10095547B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Mar 14, 2016 |
| Grant date | Oct 9, 2018 |
| Priority date | — |
| Expiry date | Sep 4, 2036 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/24568
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A system and method for data stream processing. Two or more instances are connected as a topology, wherein at least one of the instances is a spout and at least one of the instances is a bolt. The topology is submitted to a scheduler, wherein the service scheduler receives resource offers from a cluster manager representing computing resources available on one or more of cluster nodes and determines resources to accept and computations to run on the accepted computing resources. The topology is scheduled as one or more jobs, wherein each job includes two or more containers, including a first container and a second container, the first container including a topology master and the second container including a stream manager and one or more stream processing system (SPS) instances, wherein each SPS instance represents one of the instances in the topology.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.