Method and apparatus for evolving a neural network
US6516309B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Jul 14, 1999 |
| Grant date | Feb 4, 2003 |
| Priority date | — |
| Expiry date | Jul 14, 2019 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/086
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method of evolving a neural network that includes a plurality of processing elements interconnected by a plurality of weighted connections includes the step of obtaining a definition for the neural network by evolving a plurality of weights for the plurality of weighted connections, and evolving a plurality of activation function parameters associated with the plurality of processing elements. Another step of the method includes determining whether the definition for the neural network may be simplified based upon at least one activation function parameter of the plurality of activation function parameters. Yet another step of the method includes updating the definition for the neural network in response to determining that the definition for the neural network may be simplified. The method utilizes particle swarm optimization techniques to evolve the plurality of weights and the plurality of activation parameters. Moreover, the method simplifies activation functions of processing elements in response to corresponding activation parameters meeting certain criteria, and removes processing elements from the definition of the neural network in response to corresponding activation pa…
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.