Optimization of neural network in equivalent class space
US11599797B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 28, 2018 |
| Grant date | Mar 7, 2023 |
| Priority date | — |
| Expiry date | Oct 21, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/048
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
In implementations of the present disclosure, a solution for optimization of a learning network in an equivalent class space is provided. In this solution, base paths running through layers of a learning network are determined. Each node utilizes an activation function with a scaling invariant property to process an input from a node of a previous layer, each base path comprises a single node in each layer, and processing in the base paths is linearly independent from each other. A combined value of parameters associated with nodes in each base path is updated. A parameter associated with a node is used to adjust an input obtained from a node of a previous layer. Values of parameters associated with nodes in the base paths are updated based on updated combined values of parameters. Through this solution, optimization efficiency can be improved and more accurate optimized values of parameters are achieved.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.