Dynamic resource allocation of large language model deployments for conversational interface
US12254279B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | May 23, 2024 |
| Grant date | Mar 18, 2025 |
| Priority date | — |
| Expiry date | May 23, 2044 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F9/44536
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A dynamic conversation interface system includes a plurality of instances of a large language model (LLM) engine, each instance being configured according to a respective set of system directives. An agent manager engine instantiates and configures the instances of the LLM engine such that a first LLM engine instance is configured according to a first set of system directives, and a second LLM engine instance is configured according to a second set of system directives that is different from the first set. The first LLM engine instance has a different functional specialization from the second LLM engine instance, and the two instances engage in a same conversation session with a user to perform different specializations within that conversation session.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.