Repository logo
 

Novel Integrated Methods of Evolving Spiking Neural Network and Particle Swarm Optimisation

Files

Whole thesis(4.28 MB)

Date

2012

Authors

Supervisor

Kasabov, Nikola
Shamsuddin, Siti Mariyam
Schliebs, Stefan

Item type

Thesis

Degree name

Doctor of Philosophy

Journal Title

Journal ISSN

Volume Title

Publisher

Auckland University of Technology

Abstract

This thesis proposes and presents several methods for classification problems. Spatial and spatiotemporal classification problems have been considered in this study. A novel integration between Evolving Spiking Neural Network (ESNN) and Particle Swarm Optimisation (PSO) is proposed for ESNN model optimisation. ESNN, motivated by the principle of Evolving Connectionist System (ECoS), is a relatively new classifier in the neural information processing area. Proper combination of ESNN parameters would influence the ESNN performance. On the other hand, PSO is a bio-inspired optimiser and was developed based on a study of school of fish and flock of birds behaviour. In this framework, all ESNN parameters are optimised by the PSO to achieve optimal parameter combination for the model. A wrapper approach is implemented in the ESNN-PSO frameworks and a few other integrated frameworks that are also proposed in this work. The classifier uses information provided by the particles during learning and generates a fitness value for each solution candidate. Particles interact with each other and update their information based on the global best particle (gbest) and their own best solution (pbest). The learning process continues until termination criteria are met. When dealing with high dimensional problems, only some of the input features are relevant. In this case, selection of features is required. Since standard PSO is not able to handle probability computation, the quantum computation principle is embedded into PSO. This combination is referred to as Quantum-inspired Particle Swarm Optimisation (QiPSO). The integrated ESNN-QiPSO is proposed in this study for simultaneous feature selection and parameter optimisation. This combination provides promising results that may lead to better and faster learning. However, several problems have been identified that led to the development of enhanced QiPSO and ESNN. A hybrid particle and new search and update strategy is proposed for the QiPSO and is presented in the Dynamic QiPSO (DQiPSO) model. Subsequently, an integrated framework of DQiPSO and ESNN is proposed for efficient feature selection and parameter optimisation. The probabilistic element is also embedded into ESNN as part of its enhancement. In the Probabilistic ESNN (PESNN), the evolving connection is introduced. In the proposed integrated PESNN-DQiPSO, the classifier works together with the optimiser where the connection, feature and parameter components are optimised synchronously for better classification. Real world problems are often spatiotemporal. Standard ESNN architecture lacks the ability to process both spatial and temporal components in spatiotemporal problems. This study proposes two new ESNN frameworks for spatiotemporal classification utilising the reservoir computing principle. The Extended ESNN (EESNN) is proposed where a simple memory is used to accumulate all spatial and temporal information before passing them to ESNN. In the second approach, more complex Liquid State Machine (LSM) reservoir is incorporated into the ESNN. The reservoir-based ESNN (RESNN) accumulates all information and generates the reservoir responses that can be measured at any simulation time. These responses are encoded into liquid states before sending them to ESNN for classification. All proposed frameworks have been evaluated on synthetic and real world problems. This study also proposes a spatiotemporal synthetic problem called Rotating Dot. The purpose of introducing this benchmark dataset is to have a spatiotemporal problem with controllable difficulty that can be used for evaluation of the methods. In this problem, the noise can be set at a small value to generate a simple problem or at a high value for more difficult problems. Results obtained with all proposed frameworks are promising and warrant future exploration.

Description

Keywords

Spiking Neural Network, Particle Swarm Optimisation, Evolving Connectionist System, Quantum Computation, Liquid State Machine, Classification, Spatiotemporal, Spatial, Feature Selection, Parameter Optimisation

Source

DOI

Publisher's version

Rights statement

Permanent link

https://hdl.handle.net/10292/4459

Collections

Doctoral Theses