System and method for inference generation through dynamic reassignment of inference model portions
US12411710B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jul 12, 2022 |
| Grant date | Sep 9, 2025 |
| Priority date | — |
| Expiry date | Jun 14, 2044 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/045
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Methods and systems for inference generation are disclosed. To manage inference generation, a system may include an inference model manager and any number of data processing systems. The inference model manager may partition an inference model into portions. Portions of the inference model may be distributed to data processing systems in accordance with an execution plan. The execution plan may include instructions for timely execution of the inference model with respect to the needs of a downstream consumer. The inference model manager may manage execution of the inference model by monitoring the functionality of the data processing systems and dynamically re-assigning and/or re-locating data processing systems in the event that one or more data processing systems becomes unable to execute a portion of the inference model.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.