Using tiered storage and ISTIO to satisfy SLA in model serving and updates
US10972364B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | May 15, 2019 |
| Grant date | Apr 6, 2021 |
| Priority date | — |
| Expiry date | Jun 6, 2039 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L43/0852
- WIPO fieldDigital communication
- WIPO sectorElectrical engineering
Abstract
Systems, methods, and computer-readable storage media are provided for storing machine learned models in a tiered storage. The model serving network evaluates where the models should be stored based on the model corresponding service level agreement. The model is generally stored at the lowest tiered storage device that is still capable of satisfying the model's service level agreement. In this way, the model serving network aims to store data that achieves the cheapest cost.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.