Dynamic evaluation of language model prompts for model selection and output validation and methods and systems of the same
US12147513B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Apr 11, 2024 |
| Grant date | Nov 19, 2024 |
| Priority date | — |
| Expiry date | Apr 11, 2044 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F40/20
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
The systems and methods disclosed herein relate to a model validation platform that enables dynamic validation of a user's prompt for a large language model (LLM) in order to evaluate the validity of the prompt and the suitability of a large language model for processing the prompt. For example, the platform enables an estimation of the resource allocation associated with processing the prompt with a given LLM, as well as a modification of the prompt, prior to the processing the prompt with the selected LLM. The platform can further validate the output prior to transmitting the output to a server system for display to the user. By doing so, the platform enables dynamic evaluation of a request to execute an LLM, as well as evaluation of resulting outputs, for accuracy and efficiency improvements in data processing or software development pipelines.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.