Systems and methods for monitoring speech data labelers

US7711566B1 · kind B1 · utility

Assignee

• AT&T Intellectual Property I, L.P. · US

Inventors

• Lee Begeja · Gillette, US
• Richard Vandervoort Cox · New Providence, US
• Harris Drucker · Long Branch, US
• David Crawford Gibbon · Lincroft, US
• Allen Louis Gorin · Berkeley Heights, US
• Patrick Haffner · Atlantic Highlands, US
• Steven H. Lewis · Middletown, US
• Zhu Liu · Marlboro, US
• Mazin G. Rahim · Hackettstown, US
• Bernard S. Renger · New Providence, US
• Behzad Shahraray · Holmdel, US

Key dates

• Filing date: Aug 14, 2007
• Grant date: May 4, 2010
• Expiry date: Jun 18, 2028

Classification

• Technology area (CPC G): Physics
• CPC primary: G10L15/18
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

Systems and methods for using an annotation guide to label utterances and speech data with a call type. A method embodiment monitors labelers of speech data by presenting via a processor a test utterance to a labeler, receiving input from the labeler that selects a particular call type from a list of call types and determining via the processor if the labeler labeled the test utterance correctly. Based on the determining step, the method performs at least one of the following: revising the annotation guide, retraining the labeler or altering the test utterance.