Neural network learning apparatus, neural network learning method and program
US12159222B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Apr 23, 2019 |
| Grant date | Dec 3, 2024 |
| Priority date | — |
| Expiry date | Apr 4, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/09
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
There is provided a neural network learning apparatus capable of adjusting an amount of reduction in a model size. A group parameter generating part grouping model parameters of a neural network model into arbitrarily defined groups and generating group parameters indicating features of the groups, a regularization term calculating part calculating a regularization term on an assumption that distribution of the group parameters is according to distribution defined by hyper parameters which are parameters defining distribution features, and a model updating part calculating a loss function from correct labels in teacher data, output probability distribution obtained by inputting feature values corresponding to the correct labels in the teacher data to the neural network model, and a regularization term, and updating the neural network model in a manner that a value of the loss function is decreased are included.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.