Optimizing distributed and parallelized batch data processing
US11874817B2 · kind B2 · utility
Assignee
Inventor
Key dates
| Filing date | Mar 31, 2021 |
| Grant date | Jan 16, 2024 |
| Priority date | — |
| Expiry date | Aug 10, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F2209/508
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Aspects of the disclosure relate to providing and maintaining efficient and effective processing of sets of work items in enterprise computing environments by optimizing distributed and parallelized batch data processing. A computing platform may initialize a monitoring process configured to monitor a pending workload in a work queue database. Subsequently, the computing platform may cause the monitoring process to query the work queue database and create one or more historical records indicative of a workload processing status associated with one or more processing workers. Then, the computing platform may identify one or more new parameter values for one or more processing parameters associated with the one or more processing workers based on the one or more historical records. Thereafter, the computing platform may configure the one or more processing workers based on the one or more new parameter values identified for the one or more processing parameters.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.