Zhanna Sarsenbayeva
Niels van Berkel
Eduardo Velloso
Vassilis Kostakos
Skip Abstract Section
Abstract
The adverse effect of ambient noise on humans has been extensively studied in fields like cognitive science, indicating a significant impact on cognitive performance, behaviour, and emotional state. Surprisingly, the effect of ambient noise has not been studied in the context of mobile interaction. As smartphones are ubiquitous by design, smartphone users are exposed to a wide variety of ambient noises while interacting with their devices. In this paper, we present a structured analysis of the effect of six distinct ambient noise types on typical smartphone usage tasks. The evaluated ambient noise types include variants of music, urban noise and speech. We analyse task completion time and errors, and find that different ambient noises affect users differently. For example, while speech and urban noise slow down text entry, being exposed to music reduces completion time in target acquisition tasks. Our study contributes to the growing research area on situational impairments, and we compare our results to previous work on the effect of cold-induced situational impairments. Our results can be used to support smartphone users through adaptive interfaces which respond to the ongoing context of the user.
- S. Aram, A. Troiano, and E. Pasero. 2012. Environment sensing using smartphone. In 2012 IEEE Sensors Applications Symposium Proceedings. 1--4.Google Scholar
- Amy FT Arnsten and Patricia S Goldman-Rakic. 1998. Noise stress impairs prefrontal cortical cognitive function in monkeys: evidence for a hyperdopaminergic mechanism. Archives of general psychiatry 55, 4 (1998), 362--368.Google Scholar
- Alan Baddeley and Pierre Salame. 1986. The unattended speech effect: perception or memory? Journal of Experimental Psychology: Learning, Memory, and Cognition 12, 4 (1986), 525.Google ScholarCross Ref
- Simon Banbury and Dianne C Berry. 1997. Habituation and dishabituation to speech and office noise. Journal of Experimental Psychology: Applied 3, 3 (1997), 181.Google ScholarCross Ref
- Simon Banbury and Dianne C Berry. 1998. Disruption of office-related tasks by speech and office noise. British journal of psychology 89, 3 (1998), 499--517.Google Scholar
- Simon P. Banbury, William J. Macken, Sébastien Tremblay, and Dylan M. Jones. 2001. Auditory Distraction and Short-Term Memory: Phenomena and Practical Implications. Human Factors 43, 1 (2001), 12--29. arXiv:https://doi.org/10.1518/001872001775992462 PMID: 11474757.Google ScholarCross Ref
- ML Bartelink, A De Wit, H Wollersheim, A Theeuwes, and Th Thien. 1993. Skin vascular reactivity in healthy subjects: influence of hormonal status. Journal of Applied Physiology 74, 2 (1993), 727--732.Google ScholarCross Ref
- Sebastian Boring, David Ledo, Xiang 'Anthony' Chen, Nicolai Marquardt, Anthony Tang, and Saul Greenberg. 2012. The fat thumb: using the thumb's contact size for single-handed mobile interaction. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services. ACM, 39--48. Google ScholarDigital Library
- Clare Caldwell and Sally A Hibbert. 2002. The influence of music tempo and musical preference on restaurant patrons' behavior. Psychology 8 Marketing 19, 11 (2002), 895--917.Google Scholar
- Gianna Cassidy and Raymond AR MacDonald. 2007. The effect of background music and background noise on the task performance of introverts and extraverts. Psychology of Music 35, 3 (2007), 517--537.Google ScholarCross Ref
- Sheldon Cohen and Neil Weinstein. 1981. Nonauditory effects of noise on behavior and health. Journal of Social Issues 37, 1 (1981), 36--70.Google ScholarCross Ref
- Brian H Dalton and David G Behm. 2007. Effects of noise and music on human and task performance: A systematic review. Occupational Ergonomics 7, 3 (2007), 143--152.Google ScholarCross Ref
- Anind K. Dey. 2001. Understanding and Using Context. Personal Ubiquitous Comput. 5, 1 (Jan. 2001), 4--7. Google ScholarDigital Library
- Mayank Goel, Leah Findlater, and Jacob Wobbrock. 2012. WalkType: Using Accelerometer Data to Accomodate Situational Impairments in Mobile Touch Screen Text Entry. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2687--2696. Google ScholarDigital Library
- Charles J Golden and Shawna M Freshwater. 1978. Stroop color and word test. (1978).Google Scholar
- Jorge Goncalves, Vassilis Kostakos, Simo Hosio, Evangelos Karapanos, and Olga Lyra. 2013. IncluCity: Using Contextual Cues to Raise Awareness on Environmental Accessibility. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '13). ACM, New York, NY, USA, Article 17, 8 pages. Google ScholarDigital Library
- Jorge Goncalves, Zhanna Sarsenbayeva, Niels van Berkel, Chu Luo, Simo Hosio, Sirkka Risanen, Hannu Rintamäki, and Vassilis Kostakos. 2017. Tapping Task Performance on Smartphones in Cold Temperature. Interacting with Computers 29, 3 (2017), 355--367.Google Scholar
- Morgan Harvey and Matthew Pointon. 2018. Noisy Signals: Understanding the Impact of Auditory Distraction on Web Search Tasks. In Proceedings of the 2018 Conference on Human Information Interaction&Retrieval. ACM, 241--244. Google ScholarDigital Library
- Mack T Henderson, Anne Crews, and Joan Barlow. 1945. A study of the effect of music distraction on reading efficiency. Journal of Applied Psychology 29, 4 (1945), 313.Google ScholarCross Ref
- Niels Henze, Enrico Rukzio, and Susanne Boll. 2011. 100,000,000 Taps: Analysis and Improvement of Touch Performance in the Large. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '11). ACM, New York, NY, USA, 133--142. Google ScholarDigital Library
- Eve Hoggan, Andrew Crossan, Stephen A Brewster, and Topi Kaaresoja. 2009. Audio or tactile feedback: which modality when?. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 2253--2256. Google ScholarDigital Library
- Morris B Holbrook. 1981. Integrating compositional and decompositional analyses to represent the intervening role of perceptions in evaluative judgments. Journal of Marketing Research (1981), 13--28.Google Scholar
- Sharon K Holmberg and Sharon Coon. 1999. Ambient sound levels in a state psychiatric hospital. Archives of psychiatric nursing 13, 3 (1999), 117--126.Google Scholar
- Makoto Iwanaga and Takako Ito. 2002. Disturbance effect of music on processing of verbal and spatial memories. Perceptual and motor skills 94, 3_suppl (2002), 1251--1258.Google Scholar
- Kari Kallinen. 2002. Reading news from a pocket computer in a distracting environment: effects of the tempo of background music. Computers in Human Behavior 18, 5 (2002), 537--551.Google ScholarCross Ref
- Juliane Kämpfe, Peter Sedlmeier, and Frank Renkewitz. 2011. The impact of background music on adult listeners: A meta-analysis. Psychology of Music 39, 4 (2011), 424--448.Google ScholarCross Ref
- Eiman Kanjo. 2010. Noisespy: A real-time mobile phone platform for urban noise monitoring and mapping. Mobile Networks and Applications 15, 4 (2010), 562--574. Google ScholarDigital Library
- J Peter Kincaid, Robert P Fishburne Jr, Richard L Rogers, and Brad S Chissom. 1975. Derivation of new readability formulas (automated readability index, fog count and flesch reading ease formula) for navy enlisted personnel. Technical Report. Naval Technical Training Command Millington TN Research Branch.Google Scholar
- Hannu Kukka, Jorge Goncalves, Kai Wang, Tommi Puolamaa, Julien Louis, Mounib Mazouzi, and Leire Roa Barco. 2016. Utilizing Audio Cues to Raise Awareness and Entice Interaction on Public Displays. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16). ACM, New York, NY, USA, 807--811. Google ScholarDigital Library
- Yong Liu, Jorge Goncalves, Denzil Ferreira, Simo Hosio, and Vassilis Kostakos. 2014. Identity Crisis of Ubicomp?: Mapping 15 Years of the Field's Development and Paradigm Change. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14). ACM, New York, NY, USA, 75--86. Google ScholarDigital Library
- Yong Liu, Jorge Goncalves, Denzil Ferreira, Bei Xiao, Simo Hosio, and Vassilis Kostakos. 2014. CHI 1994-2013: Mapping Two Decades of Intellectual Progress Through Co-word Analysis. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3553--3562. Google ScholarDigital Library
- Randi C Martin, Michael S Wogalter, and Janice G Forlano. 1988. Reading comprehension in the presence of unattended speech and music. Journal of memory and language 27, 4 (1988), 382--398.Google ScholarCross Ref
- Heather McElrea and Lionel Standing. 1992. Fast music causes fast drinking. Perceptual and Motor skills 75, 2 (1992), 362--362.Google Scholar
- Ronald E Milliman. 1982. Using background music to affect the behavior of supermarket shoppers. The journal of Marketing (1982), 86--91.Google Scholar
- Ronald E Milliman. 1986. The influence of background music on the behavior of restaurant patrons. Journal of consumer research 13, 2 (1986), 286--289.Google ScholarCross Ref
- Sachi Mizobuchi, Mark Chignell, and David Newton. 2005. Mobile Text Entry: Relationship Between Walking Speed and Text Input Task Difficulty. In Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices 8 Services (MobileHCI '05). ACM, New York, NY, USA, 122--128. Google ScholarDigital Library
- Alexander Ng, Stephen A. Brewster, and John H. Williamson. 2014. Investigating the Effects of Encumbrance on One- and Two- Handed Interactions with Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1981--1990. Google ScholarDigital Library
- Alexander Ng, John H. Williamson, and Stephen A. Brewster. 2014. Comparing Evaluation Methods for Encumbrance and Walking on Interaction with Touchscreen Mobile Devices. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices 8 Services (MobileHCI '14). ACM, New York, NY, USA, 23--32. Google ScholarDigital Library
- Adrian C North, David J Hargreaves, and Sarah J Heath. 1998. Musical tempo and time perception in a gymnasium. Psychology of Music 26, 1 (1998), 78--88.Google ScholarCross Ref
- Theodore J. Noseworthy and Karen Finlay. 2009. A Comparison of Ambient Casino Sound and Music: Effects on Dissociation and on Perceptions of Elapsed Time While Playing Slot Machines. Journal of Gambling Studies 25, 3 (01 Sep 2009), 331--342.Google ScholarCross Ref
- Michael D Oliver. 1996. The effect of background music on mood and reading comprehension performance of at-risk college freshmen. Ph.D. Dissertation. Wayne State University.Google Scholar
- Denise C Park, Christopher Hertzog, Daniel P Kidder, Roger W Morrell, and Christopher B Mayhorn. 1997. Effect of age on event-based and time-based prospective memory. Psychology and aging 12, 2 (1997), 314.Google Scholar
- Pierre Salame and Alan Baddeley. 1982. Disruption of short-term memory by unattended speech: Implications for the structure of working memory. Journal of Verbal Learning and Verbal Behavior 21, 2 (1982), 150--164.Google ScholarCross Ref
- Pierre Salame and Alan Baddeley. 1989. Effects of background music on phonological short-term memory. The Quarterly Journal of Experimental Psychology 41, 1 (1989), 107--122.Google ScholarCross Ref
- Zhanna Sarsenbayeva, Jorge Goncalves, Juan García, Simon Klakegg, Sirkka Rissanen, Hannu Rintamäki, Jari Hannu, and Vassilis Kostakos. 2016. Situational Impairments to Mobile Interaction in Cold Environments. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 85--96. Google ScholarDigital Library
- Zhanna Sarsenbayeva, Niels van Berkel, Chu Luo, Vassilis Kostakos, and Jorge Goncalves. 2017. Challenges of Situational Impairments During Interaction with Mobile Devices. In Proceedings of the 29th Australian Conference on Computer-Human Interaction (OZCHI '17). ACM, New York, NY, USA, 477--481. Google ScholarDigital Library
- Zhanna Sarsenbayeva, Niels van Berkel, Aku Visuri, Sirkka Rissanen, Hannu Rintamäki, Vassilis Kostakos, and Jorge Goncalves. 2017. Sensing Cold-Induced Situational Impairments in Mobile Interaction Using Battery Temperature. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 98 (Sept. 2017), 9 pages. Google ScholarDigital Library
- Bastian Schildbach and Enrico Rukzio. 2010. Investigating Selection and Reading Performance on a Mobile Phone While Walking. In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '10). ACM, New York, NY, USA, 93--102. Google ScholarDigital Library
- Andrew Sears, Min Lin, Julie Jacko, and Yan Xiao. 2003. When computers fade: Pervasive computing and situationally-induced impairments and disabilities. In HCI International, Vol. 2. 1298--1302.Google Scholar
- Stephen Stansfeld, John Gallacher, Wolfgang Babisch, and Martin Shipley. 1996. Road traffic noise and psychiatric disorder: prospective findings from the Caerphilly Study. Bmj 313, 7052 (1996), 266--267.Google ScholarCross Ref
- Sébastien Tremblay, Alastair P Nicholls, David Alford, and Dylan M Jones. 2000. The irrelevant sound effect: Does speech play a special role? Journal of Experimental Psychology: Learning, Memory, and Cognition 26, 6 (2000), 1750.Google ScholarCross Ref
- Kristin Vadas, Nirmal Patel, Kent Lyons, Thad Starner, and Julie Jacko. 2006. Reading On-the-go: A Comparison of Audio and Hand-held Displays. In Proceedings of the 8th Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '06). ACM, New York, NY, USA, 219--226. Google ScholarDigital Library
- Niels van Berkel, Chu Luo, Theodoros Anagnostopoulos, Denzil Ferreira, Jorge Goncalves, Simo Hosio, and Vassilis Kostakos. 2016. A Systematic Assessment of Smartphone Usage Gaps. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4711--4721. Google ScholarDigital Library
- N Venetjoki, A Kaarlela-Tuomaala, E Keskinen, and V Hongisto. 2006. The effect of speech and speech intelligibility on task performance. Ergonomics 49, 11 (2006), 1068--1091.Google ScholarCross Ref
- We Wen and Kanachi Michihiko. 2006. The effects of music type and volume on short-term memory. Tohoku Psychol Folia 64 (2006), 68--76.Google Scholar
Index Terms
- Effect of Distinct Ambient Noise Types on Mobile Interaction
Recommendations
Challenges of situational impairments during interaction with mobile devices
OzCHI '17: Proceedings of the 29th Australian Conference on Computer-Human InteractionUser interaction with mobile devices can be negatively affected by contextual factors, known as situationally-induced impairments. In this paper, we provide a systematic overview of established situational impairments and their impact on interaction ...
Situational impairments to mobile interaction in cold environments
UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous ComputingWe evaluate the situational impairments caused by cold ambient temperature on fine-motor movement and vigilance during mobile interaction. For this purpose, we tested two mobile phone applications that measure fine motor skills and vigilance in ...
Sensing Cold-Induced Situational Impairments in Mobile Interaction Using Battery Temperature
Previous work has highlighted the detrimental effect of cold ambience on fine-motor skills during interaction with mobile devices. In this work, we develop a method to infer changes in finger temperature of smartphone users without the need for ...
Comments