studying a reinforcement learning technique for the spiking neural network

studying a reinforcement learning technique for the spiking neural network

;A. V. Kozov;A. S. Chernyshev
BMJ open 2016 pp. 174-183
204
kozov2016naukastudying

Abstract

The article describes a reinforcement learning technique for the spiking neural network. Spiking artificial neural networks, also called neural networks of the third-generation are a special class of the artificial neural networks, in which the signal is a set of impulses (spikes) of the same amplitude and duration. There is a need to use special techniques to learn these networks. Development and research of such techniques is a relevant task now. The article discusses a reinforcement learning technique for the neural network using a particular type of connections between neurons, called a hedonistic synapse. The hedonistic synapse partly reflects the properties of its real biological counterpart. It alters its activity depending on the intrinsic activity in previous times and on the reinforcement in the system. The study was conducted to define an impact of such synapse parameters on the learning efficiency of the spiking neural network. The article shows a mathematical model of the hedonic synapse and gives a description of its parameters and variables. It describes the role of these variables and parameters in reinforcement learning the neural network. To assess the learning quality are used such criteria as an error index and AUC. The article describes their application to have a generalized assessment of learning.

It also describes a generation technique and gives examples of test data used in the study. A technique to calculate the reinforcement for the network is described depending on the output signals. The impact of the variables and parameters of the hedonic synapse model on the learning quality for the neural network is analysed. The article reviews the features of the Bayesian optimization technique and describes its using to optimize quality of classification. It provides an indepth analysis of the optimization results and comes to the conclusion, as a result of the study, that such a learning technique can be used to classify the multivariate time series. The article defines potential trends for further research in the field concerned that is an optimization of the neural network structure and its applications.

Citation

ID: 251610
Ref Key: kozov2016naukastudying
Use this key to autocite in SciMatic or Thesis Manager

References

Blockchain Verification

Account:
NFT Contract Address:
0x95644003c57E6F55A65596E3D9Eac6813e3566dA
Article ID:
251610
Unique Identifier:
10.7463/0616.0842238
Network:
Scimatic Chain (ID: 481)
Loading...
Blockchain Readiness Checklist
Authors
Abstract
Journal Name
Year
Title
5/5
Creates 1,000,000 NFT tokens for this article
Token Features:
  • ERC-1155 Standard NFT
  • 1 Million Supply per Article
  • Transferable via MetaMask
  • Permanent Blockchain Record
Blockchain QR Code
Scan with Saymatik Web3.0 Wallet

Saymatik Web3.0 Wallet