Data locality-aware MapReduce using IoT devices
US10757177B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Sep 26, 2017 |
| Grant date | Aug 25, 2020 |
| Priority date | — |
| Expiry date | Apr 13, 2038 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L67/61
- WIPO fieldDigital communication
- WIPO sectorElectrical engineering
Abstract
A client network implements data locality-aware MapReduce using IoT devices. An IoT service of a provider network receives configuration settings from a user to implement map nodes and reduce nodes at the client network. Each map node is configured to receive its own locality-based partition of data from one or more data sources (e.g., sensors) that are within a map function data locality (e.g., a particular location of the network). Each map node then processes the locality-based partition of the data, generates results, and sends the results to a reduce node. The reduce node may be located at a remote provider network. A coordinator node may also be deployed to one or more devices of the client network. If a map node or a compute node becomes overloaded, the coordinator node may redirect some data to a map node or a reduce node of a remote provider network.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.