Hierarchical Data Classification Using Deep Neural Networks
| aut.relation.pages | 10 | |
| aut.relation.volume | 3 | en_NZ |
| aut.researcher | Narayanan, Ajit | |
| dc.contributor.author | Tirimula, SS | en_NZ |
| dc.contributor.author | Narayanan, A | en_NZ |
| dc.contributor.editor | Arik, S | en_NZ |
| dc.contributor.editor | Huang, T | en_NZ |
| dc.contributor.editor | Lai, WK | en_NZ |
| dc.contributor.editor | Liu, Q | en_NZ |
| dc.date.accessioned | 2017-10-15T22:52:26Z | |
| dc.date.available | 2017-10-15T22:52:26Z | |
| dc.date.copyright | 2015 | en_NZ |
| dc.date.issued | 2015 | en_NZ |
| dc.description.abstract | Deep Neural Networks (DNNs) are becoming an increasingly interesting, valuable and efficient machine learning paradigm with implementations in natural language processing, image recognition and hand-written character recognition. Application of deep architectures is increasing in domains that contain feature hierarchies (FHs) i.e. features from higher levels of the hierarchy formed by the composition of lower level features. This is because of a perceived relationship between on the one hand the hierarchical organisation of DNNs, with large numbers of neurons at the bottom layers and increasingly smaller numbers at upper layers, and on the other hand FHs, with comparatively large numbers of low level features resulting in a small number of high level features. However, it is not clear what the relationship between DNNs hierarchies and FHs should be, or whether there even exists one. Nor is it clear whether modelling FHs with a hierarchically organised DNN conveys any benefits over using non-hierarchical neural networks. This study is aimed at exploring these questions and is organized into two parts. Firstly, a taxonomic FH with associated data is generated and a DNN is trained to classify the organisms into various species depending on characteristic features. The second part involves testing the ability of DNNs to identify whether two given organisms are related or not, depending on the sharing of appropriate features in their FHs. The experimental results show that the accuracy of the classification results is reduced with the increase in ‘depth’. Further, improved performance was achieved when every hidden layer has the same number of nodes compared with DNNs with increasingly fewer hidden nodes at higher levels. In other words, our experiments show that the relationship between DNNs and FHs is not simple and may require further extensive experimental research to identify the best DNN architectures when learning FHs. | |
| dc.identifier.citation | In International Conference on Neural Information Processing (pp. 492-500). Springer, Cham. | en_NZ |
| dc.identifier.doi | 10.1007/978-3-319-26555-1 | en_NZ |
| dc.identifier.isbn | 978-3-319-26554-4 | en_NZ |
| dc.identifier.uri | https://hdl.handle.net/10292/10870 | |
| dc.publisher | Springer | en_NZ |
| dc.relation.uri | http://www.springer.com/us/book/9783319265544 | en_NZ |
| dc.rights | An author may self-archive an author-created version of his/her article on his/her own website and or in his/her institutional repository. He/she may also deposit this version on his/her funder’s or funder’s designated repository at the funder’s request or as a result of a legal obligation, provided it is not made publicly available until 12 months after official publication. He/ she may not use the publisher's PDF version, which is posted on www.springerlink.com, for the purpose of self-archiving or deposit. Furthermore, the author may only post his/her version provided acknowledgement is given to the original source of publication and a link is inserted to the published article on Springer's website. The link must be accompanied by the following text: "The final publication is available at www.springerlink.com”. (Please also see Publisher’s Version and Citation). | |
| dc.rights.accessrights | OpenAccess | en_NZ |
| dc.subject | Deep Neural Networks; Hierarchical data classification | |
| dc.title | Hierarchical Data Classification Using Deep Neural Networks | en_NZ |
| dc.type | Conference Contribution | |
| pubs.elements-id | 194065 | |
| pubs.organisational-data | /AUT | |
| pubs.organisational-data | /AUT/Design & Creative Technologies |