Patent · US Active

Using tiered storage and ISTIO to satisfy SLA in model serving and updates

US10972364B2 · kind B2 · utility

1Cited by
4References
20Claims
0Family size

Assignee

Inventors

Key dates

Filing dateMay 15, 2019
Grant dateApr 6, 2021
Priority date
Expiry dateJun 6, 2039

Classification

  • Technology area (CPC H)Electricity
  • CPC primaryH04L43/0852
  • WIPO fieldDigital communication
  • WIPO sectorElectrical engineering

Abstract

Systems, methods, and computer-readable storage media are provided for storing machine learned models in a tiered storage. The model serving network evaluates where the models should be stored based on the model corresponding service level agreement. The model is generally stored at the lowest tiered storage device that is still capable of satisfying the model's service level agreement. In this way, the model serving network aims to store data that achieves the cheapest cost.

Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.