Data processing method and apparatus, and system
US10599436B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jun 13, 2018 |
| Grant date | Mar 24, 2020 |
| Priority date | — |
| Expiry date | Sep 13, 2038 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F2209/5011
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A data processing method and apparatus are provided. A system includes a CPU pool and a storage pool, a mapper node and a reducer node respectively run on different CPUs in the CPU pool, and a remote storage area shared by the mapper node and the reducer node is delimited in the storage pool. In this method, the mapper node executes a map task, and stores a data segment obtained by executing the map task, into the remote storage area; and the reducer node directly obtains a data segment to be processed by the reducer node from the remote storage area, and executes a reduce task on the data segment. The method omits some actions in the prior art, and shortens a time for executing the Map/Reduce task.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.