Synthetic data generation for training of natural language understanding models

US11508360B2 · kind B2 · utility

Assignee

• MICROSOFT TECHNOLOGY LICENSING, LLC · US

Inventors

• Baolin Peng · Bellevue, US
• Chenguang Zhu · Sammamish, US
• Chunyuan Li · Beijing, CN
• Xiujun Li · Seattle, US
• Jinchao Li · Redmond, US
• Nanshan Zeng · Bellevue, US
• Jianfeng Gao · Woodinville, US

Key dates

• Filing date: Sep 15, 2020
• Grant date: Nov 22, 2022
• Expiry date: May 25, 2041

Classification

• Technology area (CPC G): Physics
• CPC primary: G10L15/1822
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

This document relates to machine learning. One example includes a method or technique that can be performed on a computing device. The method or technique can include obtaining a task-adapted generative model that has been tuned using one or more task-specific seed examples. The method or technique can also include inputting dialog acts into the task-adapted generative model and obtaining synthetic utterances that are output by the task-adapted generative model. The method or technique can also include populating a synthetic training corpus with synthetic training examples that include the synthetic utterances. The synthetic training corpus may be suitable for training a natural language understanding model.