Application programming interface for spinning up machine learning inferencing server on demand
US12118378B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jun 2, 2021 |
| Grant date | Oct 15, 2024 |
| Priority date | — |
| Expiry date | Apr 30, 2043 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L67/51
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method by one or more electronic devices for spinning up a scoring container on demand. The method includes receiving, from an orchestrator component via an application programming interface (API), a request to spin up the scoring container, wherein the scoring container is configured to provide scoring functionality, spinning up the scoring container responsive to receiving the request to spin up the scoring container, and providing, to the orchestrator component via the API, a response to the request to spin up the scoring container, wherein the response includes a uniform resource locator (URL) to use to submit scoring requests to the scoring container.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.