Emotion Recognition and Understanding Using EEG Data in a Brain-inspired Spiking Neural Network Architecture

Simple item page
aut.relation.conferenceInternational Joint Conference on Neural Networks (IJCNN)en_NZ
aut.researcherGholami, Maryam
dc.contributor.authorAlzhrani, Wen_NZ
dc.contributor.authorDoborjeh, Men_NZ
dc.contributor.authorDoborjeh, Zen_NZ
dc.contributor.authorKasabov, Nen_NZ
dc.date.accessioned2021-07-26T04:19:22Z
dc.date.available2021-07-26T04:19:22Z
dc.date.copyright2021en_NZ
dc.date.issued2021en_NZ
dc.description.abstractThis paper is in the scope of emotion recognition by employing a brain-inspired recurrent spiking neural network (BI-SNN) architecture for modelling, mapping, learning, classifying, visualising, and understanding of spatio-temporal Electroencephalogram (EEG) data related to different emotional states. It further explores, develops, and applies a methodology based on the NeuCube BI-SNN, that includes methods for EEG data encoding, data mapping into a 3-dimensional BI-SNN model, unsupervised learning using spike-timing dependent plasticity (STDP) rule, spike-driven supervised learning, output classification, network analysis, and model visualisation and interpretation. The research conducted to model different emotional subtypes through mapping both space (brain regions) and time (brain dynamics) components of EEG brain data into brain-inspired SNN architecture. Here, a benchmark EEG dataset was used to design an empirical study that consisted of different experiments for classification of positive emotions (calmness and happiness) and negative emotions (fear and anger). The obtained accuracy of 94.83% for EEG classification of four types of emotions was superior when compared with traditional machine learning techniques, such as Multiple Linear Regression (MLR), Multi-Layer Perceptron (MLP), and Radial Basis Function (RBF). The BI-SNN models not only detected the brain activity patterns related to positive and negative emotions with a high accuracy, but also revealed new knowledge about the brain areas activated in relation to different emotions. The research confirmed that neural activation increased in the frontal sites of brain (F7, F3, AF4) associated with positive emotions, while in the case of the negative emotions, connectivity strength was concentrated in the frontal (F4, AF3, F7, F8) and parietal sites of the brain (P7, P8). The experiments also confirm the suitability of the BI-SNN for emotion recognition using EEG data.
dc.identifier.citationIn Proceedings of the International Joint Conference on Neural Networks IJCNN 2021 (pp. 1-10). [1145]
dc.identifier.urihttps://hdl.handle.net/10292/14379
dc.publisherUlster University
dc.relation.urihttps://pure.ulster.ac.uk/en/publications/emotion-recognition-and-understanding-using-eeg-data-in-a-brain-ien_NZ
dc.rightsOpen Access
dc.rights.accessrightsOpenAccessen_NZ
dc.subjectEEG; Emotion recognition; Classification; Spiking Neural Networks
dc.titleEmotion Recognition and Understanding Using EEG Data in a Brain-inspired Spiking Neural Network Architectureen_NZ
dc.typeConference Contribution
pubs.elements-id434281
pubs.organisational-data/AUT
pubs.organisational-data/AUT/Faculty of Design & Creative Technologies
pubs.organisational-data/AUT/PBRF
pubs.organisational-data/AUT/PBRF/PBRF Design and Creative Technologies
pubs.organisational-data/AUT/PBRF/PBRF Design and Creative Technologies/PBRF ECMS
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
2021076282.pdf
Size:
1.48 MB
Format:
Adobe Portable Document Format
Description:
Conference contribution
Download
License bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
AUT Grant of Licence for Tuwhera Jun 2021.pdf
Size:
360.95 KB
Format:
Adobe Portable Document Format
Description:
Download
Collections
School of Engineering, Computer and Mathematical Sciences - Te Kura Mātai Pūhanga, Rorohiko, Pāngarau