Query evaluation in natural language processing systems
US11972223B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Jul 31, 2023 |
| Grant date | Apr 30, 2024 |
| Priority date | — |
| Expiry date | Jul 31, 2043 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F40/205
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A system may determine relevance prompts based on input documents and a relevance prompt template and may transmit the plurality of relevance prompts to a large language model for completion. The system may receive response messages including chunk relevance scores. The system may select a subset of the input documents based on the chunk relevance scores. The system may determine query response prompts including text from the selected input documents the natural language query, and a second set of natural language instructions to address the natural language query. The system may determine a response to the natural language query based on answers determined in response to the query response prompts.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.