Repository logo
 

Audio Segmentation, Classification and Visualization

Files

Whole thesis(9.54 MB)

Date

2009

Authors

Supervisor

Whalley, Jacqueline
Brooks, Stephen
MacDonell, Stephen

Item type

Thesis

Degree name

Doctor of Philosophy

Journal Title

Journal ISSN

Volume Title

Publisher

Auckland University of Technology

Abstract

This thesis presents a new approach to the visualization of audio files that simultaneously illustrates general audio properties and the component sounds that comprise a given input file. New audio segmentation and classification methods are reported that outperform existing methods. In order to visualize audio files, the audio is segmented (separated into component sounds) and then classified in order to select matching archetypal images or video that represent each audio segment and are used as templates for the visualization. Each segment's template image or video is then subjected to image processing filters that are driven by audio features. One visualization method reported represents heterogeneous audio files as a seamless image mosaic along a time axis where each component image in the mosaic maps directly to a discovered component sound. The second visualization method, video texture mosaics, builds on the ideas developed in time mosaics. A novel adaptive video texture generation method was created by using acoustic similarity detection to produce a resultant video texture that more accurately represents an audio file. Compared with existing visualization methods such as oscilloscopes and spectrograms, both approaches yield more accessible illustrations of audio files and are more suitable for casual and non expert users.

Description

Keywords

Audio, Segmentation, Classification, Visualization, Time mosaics, Video textures

Source

DOI

Publisher's version

Rights statement

Permanent link

https://hdl.handle.net/10292/802

Collections

Doctoral Theses