Patent · US Active

Method and device for student training networks with teacher networks

US11625594B2 · kind B2 · utility

0Cited by

2References

17Claims

0Family size

Assignee

Beijing Tusen Zhitu Technology Co., Ltd. · CN

Inventors

Naiyan Wang · Beijing, CN
Zehao Huang · Beijing, CN

Key dates

Filing date	Jun 9, 2018
Grant date	Apr 11, 2023
Priority date	—
Expiry date	Nov 27, 2041

Classification

Technology area (CPC G)Physics
CPC primaryG06N20/10
WIPO fieldComputer technology
WIPO sectorElectrical engineering

Abstract

A method and device for training a neural network are disclosed. The method comprises: selecting, by a training device, a teacher network performing the same functions of a student network; and iteratively training the student network and obtaining a target network, through aligning distributions of features between a first middle layer and a second middle layer corresponding to the same training sample data, so as to transfer knowledge of features of a middle layer of the teacher network to the student network.

Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.