Patent · US Active

Providing application programming interface endpoints for machine learning models

US12045678B2 · kind B2 · utility

0Cited by
7References
20Claims
0Family size

Assignee

Inventors

Key dates

Filing dateApr 26, 2023
Grant dateJul 23, 2024
Priority date—
Expiry dateApr 26, 2043

Classification

  • Technology area (CPC G)Physics
  • CPC primaryG06F2009/45595
  • WIPO fieldComputer technology
  • WIPO sectorElectrical engineering

Abstract

One or more virtual machines are launched at an application platform. At each of the one or more virtual machines, a machine learning model execution environment is instantiated for an instance of a machine learning model. A respective instance of the machine learning model is loaded to each machine learning model execution environment. Each loaded instance of the machine learning model is associated with an application programming interface (API) endpoint which can receive input data for the loaded instance of the machine learning model from a client device and return output data produced by the loaded instance of the machine learning model based on the input data.

Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.