- Author:
- Stephen Barrass,
- Adviser:
- Phil Robertson
The prospect of computer applications making “noises” is disconcerting to some. Yet the soundscape of the real world does not usually bother us. Perhaps we only notice a nuisance__ __ This thesis is an approach for designing sounds that are useful information rather than distracting “noise”. The approach is called TaDa because the sounds are designed to be useful in a Task and true to the Data.
Previous researchers in auditory display have identified issues that need to be addressed for the field to progress. The TaDa approach is an integrated approach that addresses an array of these issues through a multifaceted system of methods drawn from HCI, visualisation, graphic design and sound design. A task-analysis addresses the issue of usefulness. A data characterisation addresses perceptual faithfulness. A case-based method provides semantic linkage to the application domain. A rule-based method addresses psychoacoustic control. A perceptually linearised sound space allows transportable auditory specifications. Most of these methods have not been used to design auditory displays before, and each has been specially adapted for this design domain.
The TaDa methods have been built into computer-aided design tools that can assist the design of a more effective display, and may allow less than experienced designers to make effective use of sounds. The case-based method is supported by a database of examples that can be searched by an information analysis of the design scenario. The rule-based method is supported by a direct manipulation interface which shows the available sound gamut of an audio device as a 3D coloured object that can be sliced and picked with the mouse. These computer-aided tools are the first of their kind to be developed in auditory display.
The approach, methods and tools are demonstrated in scenarios from the domains of mining exploration, resource monitoring and climatology. These practical applications show that sounds can be useful in a wide variety of information processing activities which have not been explored before. The sounds provide information that is difficult to obtain visually, and improve the directness of interactions by providing additional affordances.
Cited By
Quinton M, McGregor I and Benyon D Sonification of an exoplanetary atmosphere Proceedings of the 15th International Audio Mostly Conference, (191-198)- Goudarzi V Exploration of sonification design process through an interdisciplinary workshop Proceedings of the Audio Mostly 2016, (147-153)
- Lee J and Chang Y A study of developing auditory icons for mobile phone service applications in taiwan region Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services, (480-485)
- Csapó Á and Wersényi G (2013). Overview of auditory representations in human-machine interfaces, ACM Computing Surveys, 46:2, (1-23), Online publication date: 1-Nov-2013.
- Goudarzi V SYSSON CHI '13 Extended Abstracts on Human Factors in Computing Systems, (1921-1924)
- Alonso-Arevalo M, Shelley S, Hermes D, Hollowood J, Pettitt M, Sharples S and Kohlrausch A (2012). Curve shape and curvature perception through interactive sonification, ACM Transactions on Applied Perception (TAP), 9:4, (1-19), Online publication date: 1-Oct-2012.
- Langlois S, Loiseau S, Tardieu J, Cera A and Misdariis N Evaluation de la sonifcation d'un système multimédia automobile Proceedings of the 22nd Conference on l'Interaction Homme-Machine, (173-180)
- Lombardo V, Valle A and Nunnari F Tabula ex-cambio Proceedings of the 17th ACM international conference on Multimedia, (1053-1062)
- Brazil E A review of methods and frameworks for sonic interaction design Proceedings of the 6th international conference on Auditory Display, (41-67)
- Schaffert N, Mattes K and Effenberg A A sound design for acoustic feedback in elite sports Proceedings of the 6th international conference on Auditory Display, (143-165)
- Coleman G, Macaulay C and Newell A Sonic mapping Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges, (83-92)
- Song H and Beilharz K Aesthetic and auditory enhancements for multi-stream information sonification Proceedings of the 3rd international conference on Digital Interactive Media in Entertainment and Arts, (224-231)
- Frauenberger C Ears ))) CHI '07 Extended Abstracts on Human Factors in Computing Systems, (1641-1644)
- Ibrahim A and Hunt A Combining data-state and ctt diagrams in modeling sonification applications Proceedings of the 25th annual ACM international conference on Design of communication, (148-154)
- Frauenberger C, Stockman T and Bourguet M Pattern design in the context space Proceedings of the 14th Conference on Pattern Languages of Programs, (1-7)
- Frauenberger C, Stockman T and Bourguet M A survey on common practice in designing audio in the user interface Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 1, (187-194)
- Ibrahim A Task analysis for sonification applications usability evaluation Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility, (289-290)
- Coleman G, Macaulay C and Newell A Listen to this Proceedings of the First international conference on Haptic and Audio Interaction Design, (133-144)
- Ibrahim A and Hunt A An HCI model for usability of sonification applications Proceedings of the 5th international conference on Task models and diagrams for users interface design, (245-258)
- Fernstrom M, Brazil E and Bannon L (2005). HCI Design and Interactive Sonification for Fingers and Ears, IEEE MultiMedia, 12:2, (36-44), Online publication date: 1-Apr-2005.
- Nesbitt K and Barrass S (2004). Finding Trading Patterns in Stock Market Data, IEEE Computer Graphics and Applications, 24:5, (45-55), Online publication date: 1-Sep-2004.
- Walker B, Lindsay J and Godfrey J The audio abacus Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility, (9-15)
- Walker B, Lindsay J and Godfrey J (2003). The audio abacus, ACM SIGACCESS Accessibility and Computing:77-78, (9-15), Online publication date: 1-Sep-2003.
- Fröhlich B, Barrass S, Zehner B, Plate J and Göbel M Exploring geo-scientific data in virtual environments Proceedings of the conference on Visualization '99: celebrating ten years, (169-173)
Recommendations
Immersive auditory display system 'sound cask': three-dimensional sound field reproduction system based on the boundary surface control principle
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologySound cask was developed to realize the perfect 3D auditory display that creates 3D sound waves around the listener's head just the same as the primary sound field, based on the boundary surface control (BoSC) principle.
If we consider the sound ...
Comparisons of Auditory Impressions and Auditory Imagery Associated with Onomatopoeic Representation for Environmental Sounds
Humans represent sounds to others and receive information about sounds from others using onomatopoeia. Such representation is useful for obtaining and reporting the acoustic features and impressions of actual sounds without having to hear or emit them. ...
Aesthetic and auditory enhancements for multi-stream information sonification
DIMEA '08: Proceedings of the 3rd international conference on Digital Interactive Media in Entertainment and ArtsSonification is an emerging modality of information representation, the auditory equivalent of visualization employing non-speech sound to display attributes of form, pattern, recurrence and trends in abstract data. Like data-art or visual and auditory ...