Jong, Joris de (2021) Controlling Recurrent Neural Networks by Diagonal Conceptors. Master's Thesis / Essay, Mathematics.
|
Text
mMath_2021_deJongJP.pdf Download (1MB) | Preview |
|
![[img]](https://fse.studenttheses.ub.rug.nl/style/images/fileicons/text.png) |
Text
toestemming.pdf Restricted to Registered users only Download (96kB) |
Abstract
The human brain is capable of learning, memorizing, and regenerating a panoply of temporal patterns. A neuro-dynamical mechanism called conceptors offers a method for controlling the dynamics of a recurrent neural network by which a variety of temporal patterns can be learned and recalled. However, conceptors are matrices whose size scales quadratically with the number of neurons in the recurrent neural network, hence they quickly become impractical. In the work reported in this thesis, a variation of conceptors is introduced, called diagonal conceptors, which are diagonal matrices, thus reducing the computational cost drastically. It will be shown that diagonal conceptors achieve the same accuracy as conceptors, but are slightly more unstable. This instability can be improved, but requires further research. Nevertheless, diagonal conceptors show to be a promising practical alternative to the standard full matrix conceptors.
| Item Type: | Thesis (Master's Thesis / Essay) |
|---|---|
| Supervisor name: | Jaeger, H. and Hirsch, C.P. |
| Degree programme: | Mathematics |
| Thesis type: | Master's Thesis / Essay |
| Language: | English |
| Date Deposited: | 01 Jul 2021 09:52 |
| Last Modified: | 01 Jul 2021 09:52 |
| URI: | https://fse.studenttheses.ub.rug.nl/id/eprint/24863 |
Actions (login required)
 |
View Item |