Automated quality assurance checks for improving the construction of natural language understanding systems
US9690771B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Aug 6, 2014 |
| Grant date | Jun 27, 2017 |
| Priority date | — |
| Expiry date | Jul 15, 2035 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F40/284
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Aspects described herein provide quality assurance checks for improving the construction of natural language understanding grammars. An annotation module may obtain a set of annotations for a set of text samples based, at least in part, on an ontology and a grammar. A quality assurance module may automatically perform one or more quality assurance checks on the set of annotations, the ontology, the grammar, or combinations thereof. The quality assurance module may generate a list of flagged annotations during performance of a quality assurance check. The list of flagged annotations may be presented at an annotation review interface displayed at a display device. One of the flagged annotations may be selected and presented at an annotation interface displayed at the display device. Responsive to presentation of the flagged annotation, the ontology, the grammar, the flagged annotation selected, or combinations thereof may be updated based on user input received.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.