System and method for evaluating the performance and usage of a question answering cognitive computing tool
US12093799B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jan 13, 2023 |
| Grant date | Sep 17, 2024 |
| Priority date | — |
| Expiry date | Jan 13, 2043 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06Q10/10
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A system and method for evaluating the performance and usage of a cognitive computing tool which answers questions from users. A log file for these interactions includes the questions, the answers and a confidence rating assigned by the tool to each answer. Questions and answers are analyzed to determine validity, accuracy, and categories by subject matter experts or text analytics tools, and the results are added to the log file. Comments and sentiments from users may be analyzed and added to the log file. Additional data about the users, such as identities, demographics, and locations, may be added. Data from the log file may be presented in a dashboard display as metrics, such as trends and comparisons, describing the usage and performance of the cognitive computing tool. Answers may be displayed as they were presented to the users. Selectable filters may be provided to control the data displayed.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.