Brian Cullen
ABSTRACT
Although studies have examined sound localization or stereoscopic perception, few have investigated how these phenomena work together. Studies that examine 2D imagery and sound interaction have highlighted numerous phenomena in the temporal, spatial, and the formal domains of each medium. With the resurgence of interest in stereoscopic 3D (S3D), research into the combined effects of S3D and sound is of importance.
Here we present the results of an experiment that examined the effects of sound on depth perception in relation to S3D video game imagery. Our aim was to answer the question: "can a sound's timbre and/or the addition of distance audio effects influence the user's depth perception accuracy?" Results suggest that depth perception is affected by sound, were sound can distort the apparent depth of audible S3D objects. Results also suggest that audio effects, specifically frequency fall-off over distance effects, can also influence the apparent depth of S3D objects.
- Spottiswoode, R., and Spottiswoode, N. 1953. The Theory of Stereoscopic Transmission & Its Application to the Motion Picture. University of California Press.Google Scholar
- Howard, I. P. 2012. Perceiving in Depth, Volume 1: Basic Mechanisms. Oxford University Press.Google Scholar
- Mikšícek, F. 2006. Causes of Visual Fatigue and Its Improvements in Stereoscopy. Engineering.Google Scholar
- M. Lang, A. Hornung, O. Wang, S. Poulakos, A. Smolic, and M. Gross. 2010. Nonlinear disparity mapping for stereoscopic 3D. In ACM SIGGRAPH 2010 papers, Hugues Hoppe (Ed.). Article 75, DOI=10.1145/1833349.1778812 Google ScholarDigital Library
- H-S. Lin, S-H. Guan, C-T. Lee, and M. Ouhyoung. 2011. Stereoscopic 3D experience optimization using cropping and warping. In SIGGRAPH Asia 2011 Sketches (SA '11). Article 40. DOI=10.1145/2077378.2077428 Google ScholarDigital Library
- A. Chalmers, and K. Debattista. 2009. Levels of realism for serious games. In Proc. IEEE Games and Virtual Worlds for Serious Applications, Coventry, UK. 225--232. Google ScholarDigital Library
- H. McGurk, and J. MacDonald. 1976. Hearing lips and seeing voices. Nature, 264, 746--748.Google ScholarCross Ref
- G. Mastoropoulou, K. Debattista, A. Chalmers, and T. Troscianco. 2005. The influence of sound effects on the perceived smoothness of rendered animations. In Proc. 2nd Symposium on Applied Perception in Graphics and Visualization, La Coruña, Spain, August 26--28, 9--15. Google ScholarDigital Library
- P. Larsson, D. Västjäll, and M. Kleiner. 2003. On the quality of experience: A multi-modal approach to perceptual ego-motion and sensed presence in virtual environments. In Proc. First International Speech Communications Association Tutorial and Research Workshop on Auditory Quality of Systems, Akademie Mont-Cenis, Germany.Google Scholar
- P. Bertelson, and Radeau. 1981. Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Percept. Psychophys, 29,6, 578--584.Google ScholarCross Ref
- S. L. Storms, and M. J. Zyda. 2000. Interactions in perceived quality of auditory-visual displays. Presence: Teleoperators and Virtual Environments, 9, 6, 557--580. Google ScholarDigital Library
- Turner, A., Berry, J., & Holliman, N. 2011. Can the perception of depth in stereoscopic images be influenced by 3D sound? Displays, 7863 (February).Google Scholar
- Inition StereoBrain Calculator from Inition. (n.d.). Retrieved April 28, 2012, from http://www.inition.co.uk/3D-Technologies/inition-stereobrain-calculatorGoogle Scholar
- Zahorik, P., Brungart, D. S., and Bronkhorst, A. W. (2005). Auditory distance perception in humans: A summary of past and present research. Acta Acustica United With Acustica, 91(3), 409--420. S. Hirzel Verlag.Google Scholar
Index Terms
- The effects of audio on depth perception in S3D games
Recommendations
Clinically Normal Stereopsis Does Not Ensure a Performance Benefit from Stereoscopic 3D Depth Cues
To investigate the effect of manipulating disparity on task performance and viewing comfort, twelve participants were tested on a virtual object precision placement task while viewing a stereoscopic 3D (S3D) display. All participants had normal or ...
Depth of Field Affects Perceived Depth in Stereographs
Although it has been reported that depth of field influences depth perception in nonstereo photographs, it remains unclear how depth of field affects depth perception under stereo viewing conditions. We showed participants stereo photographs with ...
Depth information from binocular disparity and familiar size is combined when reaching towards virtual objects
VRST '16: Proceedings of the 22nd ACM Conference on Virtual Reality Software and TechnologyReaching movements towards stereoscopically presented virtual objects have been reported to be imprecise. This might be a problem for touch interaction with virtual environments. Estimating the distance to an object in personal space relies on binocular ...
Comments