Systems and methods for monitoring speech data labelers

US8170880B2 · kind B2 · utility

Assignee

• AT&T Intellectual Property I, L.P. · US

Inventors

• Lee Begeja · Gillette, US
• Richard Vandervoort Cox · New Providence, US
• Harris Drucker · Long Branch, US
• David Crawford Gibbon · Lincroft, US
• Allen Louis Gorin · Berkeley Heights, US
• Patrick Haffner · Atlantic Highlands, US
• Steven H. Lewis · Middletown, US
• Zhu Liu · Marlboro, US
• Mazin G. Rahim · Hackettstown, US
• Bernard S. Renger · New Providence, US
• Behzad Shahraray · Holmdel, US

Key dates

• Filing date: May 3, 2010
• Grant date: May 1, 2012
• Expiry date: Jul 7, 2030

Classification

• Technology area (CPC G): Physics
• CPC primary: G10L15/18
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

Systems and methods herein use an annotation guide to label utterances and speech data with a call type. A system practicing the method embodiment monitors labelers of speech data by presenting via a processor a test utterance to a labeler, receiving input from the labeler that selects a particular call type from a list of call types and determining via the processor if the labeler labeled the test utterance correctly. Based on the determining step, the system revises the annotation guide, retrains the labeler, and/or alters the test utterance.