Method and system for application programming interface based container service for supporting multiple machine learning applications
US12340239B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jun 2, 2021 |
| Grant date | Jun 24, 2025 |
| Priority date | — |
| Expiry date | Apr 25, 2044 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L67/133
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method and system for an application programming interface (API) based container service for supporting multiple machine learning (ML) applications is described. In particular, a scoring service container includes a base scorer to interface with a ML serving infrastructure using the API. The scoring service container also includes an application specific scorer, which itself includes a model loader and a scoring function. A model identifier is provided to the model loader, and it provides a model object. At least some parameters in a request from a client application are passed to scoring function, which produces a scoring. The base scorer returns the scoring according to the API to the ML serving infrastructure for delivery to the client application.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.