Usage based resource utilization of training pool for chatbots
US12112560B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jan 7, 2022 |
| Grant date | Oct 8, 2024 |
| Priority date | — |
| Expiry date | Apr 15, 2043 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L51/02
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A training request including an identifier that is indicative of a type of a machine learning (ML) model that is to be trained is received. A plurality of workers are maintained in a training pool, and a plurality of jobs are maintained in a queue of training jobs. Each worker is configured to train a particular type of ML model. Upon the training request being validated, a training job is created for the request and submitted to the queue of training jobs. For each type of ML model, a first metric and a second metric is obtained. A target metric is computed based on the first and the second metrics. The number of workers included in the training pool is modified based on the target metric.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.