Health checking a question answering cognitive computing system built on a baseline of ground truth virtual checksum
US9471877B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 10, 2015 |
| Grant date | Oct 18, 2016 |
| Priority date | — |
| Expiry date | Dec 10, 2035 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N5/022
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A mechanism is provided in a data processing system for performing a health check on a question answering system instance. The mechanism embeds a ground truth virtual checksum in a shared library accessible by the question answering system instance. The question answering system instance is trained using the ground truth virtual checksum as part of a ground truth including domain-specific ground truth. The ground truth virtual checksum comprises a test question, an answer to the test question, and a confidence level range for the answer to the test question. Responsive to a health check monitor triggering a health check servlet executing on the question answering system instance, the health check servlet submits a test question from the ground truth virtual checksum to the question answering system instance and receives a result answer and a result confidence value. Responsive to the health check servlet determining the result answer and the result confidence value match the ground truth virtual checksum, the health check servlet notifies the health check monitor that the question answering system instance is functional.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.