Nan Zhao
Skip Abstract Section
Abstract
Atmosphere - the sensorial qualities of a space, shaped by the composition of light, sound, objects, people, etc. - has remarkable influence on our experiences and behavior. Manipulating it has been shown to be powerful, affecting cognitive performance, mood and even physiology, our work envisions and implements a smart office prototype, capable of digitally transforming its atmosphere - creating what we call Mediated Atmospheres (MA) - using computationally controlled lighting, video projection and sound. Additionally, we equipped this space with a modular real-time data collection infrastructure, integrating a set of biosignal sensors. Through a user study (N=29) we demonstrate MA's effects on occupants’ ability to focus and to recover from a stressful situation. Our evaluation is based on subjective measurements of perception, as well as objective measurements, extracted from recordings of heart rate variability and facial features. We compare multiple signal processing approaches for quantifying changes in occupant physiological state. Our findings show that MA significantly (p<0.05) affect occupants’ perception as well as physiological response, which encouragingly correlate with occupants’ perception. Our findings is a first step towards personalized control of the ambient atmosphere to support wellbeing and productivity.
- Matthew Aldrich, Nan Zhao, and Joseph Paradiso. 2010. Energy efficient control of polychromatic solid state lighting using a sensor network. Tenth International Conference on Solid State Lighting 7784 (2010), 778408--778408--15.Google Scholar
- Matthew Matthew Henry Aldrich. 2014. Experiential lighting: development and validation of perception-based lighting controls. (2014).Google Scholar
- Judith Amores Fernandez. 2016. Essence: olfactory interfaces for unconscious influence of mood and cognitive performance. (2016).Google Scholar
- A A Bak and D E Grobbee. 1990. A randomized study on coffee and blood pressure. Journal of human hypertension 4, 3 (1990), 259--264.Google Scholar
- Louise Barkhuus and Anind Dey. 2003. Is context-aware computing taking control away from the user? Three levels of interactivity examined. In International Conference on Ubiquitous Computing. Springer, 149--156.Google ScholarCross Ref
- Robert A Baron. 1994. The physical environment of work settings: Effects on task performance, interpersonal relations, and job satisfaction. Research in organizational behavior 16 (1994), 1.Google Scholar
- Hrvoje Benko, Andrew D. Wilson, and Federico Zannier. 2014. Dyadic Projected Spatial Augmented Reality. In Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST). 645--655. Google ScholarDigital Library
- Gary G Berntson. 1997. and interpretive caveats. Psychophysiology 34 (1997), 623--648.Google ScholarCross Ref
- P. R. Boyce, Jennifer A. Veitch, G. R. Newsham, C. C. Jones, J. Heerwagen, M. Myer, and C. M. Hunter. 2006. Lighting quality and office work: Two field simulation experiments. Lighting Research and Technology 38, 3 (2006), 191--223.Google ScholarCross Ref
- Nancy H Chen, Jason Nawyn, Maria Thompson, Julie Gibbs, and Kent Larson. 2013. Context-aware tunable office lighting application and user response. In SPIE Optical Engineering+ Applications, Vol. 8835. International Society for Optics and Photonics, 883507.Google Scholar
- Luca Chittaro and Riccardo Sioni. 2014. Affective computing vs. Affective placebo: Study of a biofeedback- controlled game for relaxation training. International Journal of Human Computer Studies 72, 8-9 (2014), 663--673. Google ScholarDigital Library
- Hwan-Hee Choi, Jeroen J. G. van Merriënboer, and Fred Paas. 2014. Effects of the Physical Environment on Cognitive Load and Learning: Towards a New Model of Cognitive Load. Educational Psychology Review 26, 2 (2014), 225--244.Google ScholarCross Ref
- B Cimprich. 1990. Attentional fatigue and restoration in individuals with cancer. Ph.D. Dissertation. Michigan: University of Michigan.Google Scholar
- Bernadine Cimprich. 1993. Development of an intervention to restore attention in cancer patients. Cancer nursing 16, 2 (1993), 83--92.Google Scholar
- Geo Clausen and David P Wyon. 2008. The combined effects of many different indoor environmental factors on acceptability and office work performance. HVAC8R Research 14, 1 (2008), 103--113.Google Scholar
- Diane J. Cook, Aaron S. Crandall, Brian L. Thomas, and Narayanan C. Krishnan. 2013. CASAS: A smart home in a box. Computer 46, 7 (2013), 62--69. arXiv:NIHMS150003. Google ScholarDigital Library
- Fernando De la Torre, Wen-Sheng Chu, Xuehan Xiong, Francisco Vicente, Xiaoyu Ding, and Jeffrey Cohn. 2015. Intraface. In Automatic Face and Gesture Recognition (FG), 2015 11th IEEE International Conference and Workshops on, Vol. 1. IEEE, 1--8.Google ScholarCross Ref
- ETS. 2016. The GRE Tests. (2016). http://www.ets.org/gre/Google Scholar
- Mark Feldmeier and Joseph A. Paradiso. 2010. Personalized HVAC control system. In Internet of Things (IOT), 2010. IEEE, 1--8.Google Scholar
- Abe Fettig. 2005. Twisted network programming essentials. O’Reilly Media, Inc. Google ScholarDigital Library
- Mariana G Figueiro, G. C. Brainard, and R. White Lockley, S. W., V. L. Revell. 2008. Light and human health: An overview of the impact of optical Radiation on visual, circadian, neuroendocrine, and neurobehavioral responses. Technical Report. arXiv:arXiv:1011.1669v3Google Scholar
- Mariana G. Figueiro, Brittany Wood, Barbara Plitnick, and Mark S. Rea. 2011. The impact of light from computer monitors on melatonin levels in college students. Neuroendocrinology Letters 32, 2 (2011), 158--163. DOI:https://doi.org/NEL320211A03{pii}Google Scholar
- Monika Frontczak and Pawel Wargocki. 2011. Literature survey on how different factors influence human comfort in indoor environments. Building and Environment 46, 4 (2011), 922--937.Google ScholarCross Ref
- Gensler. 2013. 2013 U.S. Workplace Survey Key Findings. Technical Report.Google Scholar
- V F Gladwell, D K Brown, Joanna L Barton, M P Tarvainen, P Kuoppa, J Pretty, J M Suddaby, and G R H Sandercock. 2012. The effects of views of nature on autonomic control. European journal of applied physiology 112, 9 (2012), 3379--3386.Google Scholar
- Joshua J. Gooley, Kyle Chamberlain, Kurt A. Smith, Sat Bir S Khalsa, Shantha M W Rajaratnam, Eliza Van Reen, Jamie M. Zeitzer, Charles A. Czeisler, and Steven W. Lockley. 2011. Exposure to room light before bedtime suppresses melatonin onset and shortens melatonin duration in humans. Journal of Clinical Endocrinology and Metabolism 96, 3 (2011).Google ScholarCross Ref
- D Gromala. 2001. Meditation Chamber. SIGGRAPH 2001 Conf. Abstracts and Applications, ACM Press (2001), 127.Google Scholar
- Sharaf Hameed, Jyri Pakarinen, Kari Valde, and Ville Pulkki. 2004. Psychoacoustic cues in room size perception. In Audio Engineering Society Convention 116. Audio Engineering Society, 1--7.Google Scholar
- Terry Hartig and Henk Staats. 2003. Guest Editors’ introduction: Restorative environments. Journal of Environmental Psychology 23, 2 (2003), 103--107.Google ScholarCross Ref
- Gerald Häubl and Kyle B Murray. 2003. Preference construction and persistence in digital marketplaces: The role of electronic recommendation agents. Journal of Consumer Psychology 13, 1-2 (2003), 75--91.Google ScholarCross Ref
- Thomas R Herzog, P Maguire, and Mary B Nebel. 2003. Assessing the restorative components of environments. Journal of Environmental Psychology 23, 2 (2003), 159--170.Google ScholarCross Ref
- W.A. Wijnand IJsselsteijn, Willem Oosting, I.M. Ingrid Vogels, Yvonne Y.A.W. de Kort, Evert van Loenen, De Kort, Van Loenen, W.A. Wijnand IJsselsteijn, Willem Oosting, I.M. Ingrid Vogels, Yvonne Y.A.W. de Kort, and Evert van Loenen. 2006. Looking At or Looking Out : Exploring Monocular Cues to Create a See-Through Experience with a Virtual Window. Proc. of PRESENCE (2006), 87--95.Google Scholar
- Hiroshi Ishii, Craig Wisneski, Scott Brave, Andrew Dahley, Matt Gorbet, Brygg Ullmer, and Paul Yarin. 1998. ambientROOM: Integrating Ambient Media with Architectural Space. In Proceedings of the Conference on Human Factors in Computing Systems: Making the Impossible Possible (CHI’98). 173--174. Google ScholarDigital Library
- H 1 Ising and B Kruppa. 2004. Health effects caused by noise: evidence in the literature from the past 25 years. Noise and Health 6, 22 (2004), 5.Google Scholar
- Sang-joong Jung, Heung-sub Shin, and Wan-young Chung. 2014. Driver fatigue and drowsiness monitoring system with embedded electrocardiogram sensor on steering wheel. IET Intelligent Transport Systems 8, 1 (2014), 43--50.Google ScholarCross Ref
- Peter H Kahn, Batya Friedman, Brian Gill, Jennifer Hagman, Rachel L Severson, Nathan G Freier, Erika N Feldman, and Sybil Carre. 2008. A plasma display window ? The shifting baseline problem in a technologically mediated natural world. Journal of Environmental Psychology 28 (2008), 192--199.Google ScholarCross Ref
- Stephen Kaplan. 1995. The restorative effects of nature: Toward an integrative framework. Journal of Environmental Psychology 16, 1995 (1995), 169--182. DOI:https://doi.org/02724944/95/030169+14Âğ12.00/0Google Scholar
- Wolfgang Klimesch. 1999. EEG alpha and theta oscillations reflect cognitive and memory performance: A review and analysis. Brain Research Reviews 29, 2-3 (1999), 169--195.Google ScholarCross Ref
- Igor Knez. 1995. Effects of indoor lighting on mood and cognition. Journal of Environmental Psychology 15, 1 (1995), 39--51.Google ScholarCross Ref
- Enrique Leon, Graham Clarke, Victor Callaghan, Faiyaz Doctor, Enrique Leon, Graham Clarke, Victor Callaghan, and Faiyaz Doctor. 2010. Affect-aware behaviour modelling and control inside an Intelligent Environment. Pervasive and Mobile Computing Journal 6, 4 (2010), 1--44. Google ScholarDigital Library
- Remco Magielse and Philip R. Ross. 2011. A design approach to socially adaptive lighting environments. In Proceedings of the 9th ACM SIGCHI Italian Chapter International Conference on Computer-Human Interaction Facing Complexity - CHItaly. ACM Press, New York, New York, USA, 171. Google ScholarDigital Library
- Nicola Mammarella, Beth Fairfield, and Cesare Cornoldi. 2007. Does music enhance cognitive performance in healthy older adults ? The Vivaldi effect. Aging clinical and experimental research 19, 5 (2007), 394--399.Google Scholar
- Janetta Mitchell McCoy and Gary W Evans. 2002. The potential role of the physical environment in fostering creativity. Creativity Research Journal 14, 3-4 (2002), 409--426.Google ScholarCross Ref
- Ravi Mehta, Rui Juliet Zhu, and Amar Cheema. 2012. Is noise always bad? Exploring the effects of ambient noise on creative cognition. Journal of Consumer Research 39, 4 (2012), 784--799.Google ScholarCross Ref
- Martina T Mitterschiffthaler, Cynthia H Y Fu, Jeffrey A Dalton, Christopher M Andrew, and Steven C R Williams. 2007. Functional MRI study of happy and sad âĂŞ affective states induced by classical music. Human brain mapping 28, 11 (2007), 1150--1162.Google Scholar
- M. S. Mott, D. H. Robinson, A. Walden, J. Burnette, and A. S. Rutherford. 2012. Illuminating the Effects of Dynamic Lighting on Student Learning. SAGE Open 2, 2 (2012), 2158244012445585--.Google Scholar
- Michael Mozer, Robert Dodier, Debra Miller, Marc Anderson, J Anderson, D Bertini, M Bronder, M Colagrosso, R Cruickshank, and B Daugherty. 2005. The adaptive house. In IEE Seminar Digests, Vol. 11059. IET, v1--39.Google ScholarCross Ref
- Jifei Ou, Gershon Dublon, Chin-Yi Cheng, Felix Heibeck, Karl Willis, and Hiroshi Ishii. 2016. Cilllia: 3D Printed Micro-Pillar Structures for Surface Texture, Actuation and Sensing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5753--5764. Google ScholarDigital Library
- Margherita Pasini, Rita Berto, Margherita Brondino, Rob Hall, and Catherine Ortner. 2014. How to measure the restorative quality of environments: The PRS-11. Procedia-Social and Behavioral Sciences 159 (2014), 293--297.Google ScholarCross Ref
- Charith Perera, Arkady Zaslavsky, Peter Christen, and Dimitrios Georgakopoulos. 2014. Context aware computing for the internet of things: A survey. IEEE Communications Surveys and Tutorials 16 (2014), 414--454.Google ScholarCross Ref
- R Raskar, G Welch, M Cutts, and A Lake. 1998. The office of the future: A unified approach to image-based modeling and spatially immersive displays. Proceedings of the 25th … (1998), 1--10. Google ScholarDigital Library
- D Schmidt, Michael Stal, Hans Rohnert, and F Bushmann. 2000. Patterns for Concurrent and Networked Objects, volume 2 of Pattern-Oriented Software Architecture. (2000). Google ScholarDigital Library
- Holger Schnädelbach, Kevin Glover, and Ainojie Alexander Irune. 2010. ExoBuilding : Breathing Life into Architecture. In proceedings of the 6th Nordic Conference on Human-Computer Interaction. 442--451. Google ScholarDigital Library
- Vipul Singhvi, Andreas Krause, Carlos Guestrin, James H Garrett Jr, and H Scott Matthews. 2005. Intelligent Light Control using Sensor Networks. In Proceedings of the 3rd international conference on Embedded networked sensor systems. 218--229. Google ScholarDigital Library
- Anne-mie Sponselee, Yvonne De Kort, and Anneloes Meijnders. 2004. Healing Media : The moderating role of presence in restoring from stress in a mediated environment. Presence January (2004), 197--203.Google Scholar
- Steelcase Global Report. 2016. Engagement and the Global Workplace. Technical Report.Google Scholar
- Mika P Tarvainen, Juha-Pekka Niskanen, Jukka A Lipponen, Perttu O Ranta-Aho, and Pasi A Karjalainen. 2014. Kubios HRVâĂŞheart rate variability analysis software. Computer methods and programs in biomedicine 113, 1 (2014), 210--220. Google ScholarDigital Library
- Carolyn M. Tennessen and Bernadine Cimprich. 1995. Views to nature: Effects on attention. Journal of Environmental Psychology 15, 1 (1995), 77--85.Google ScholarCross Ref
- Martin Tomitsch, Thomas Grechenig, Andrew Vande Moere, and Sheldon Renan. 2008. Information sky: Exploring the visualization of information on architectural ceilings. In Proceedings of the International Conference on Information Visualisation. 100--105. Google ScholarDigital Library
- Mikko P Tulppo, Timo H Mäkikallio, Tapio Seppänen, Raija T Laukkanen, and Heikki V Huikuri. 1998. Vagal modulation of heart rate during exercise: effects of age and physical fitness. American Journal of Physiology-Heart and Circulatory Physiology 274, 2 (1998), H424--H429.Google ScholarCross Ref
- Jay Vidyarthi, Bernhard E Riecke, and Diane Gromala. 2012. Sonic Cradle : Designing for an Immersive Experience of Meditation by Connecting Respiration to Music. In Proc. DIS 2012. 408--417. Google ScholarDigital Library
- Glenn F Wilson and Christopher A Russell. 2003. Real-time assessment of mental workload using psychophysiological measures and artificial neural networks. Human Factors: The Journal of the Human Factors and Ergonomics Society 45, 4 (2003), 635--644.Google ScholarCross Ref
- Hy Y Wu. 2012. An empirical study of UK living labs. Proceedings of International Association for Management of Technology IAMOT (2012), 1--21. http://cswww.essex.ac.uk/staff/vic/papers/misc/2012Google Scholar
- Zephyr. 2016. Bioharness 3. (2016).Google Scholar
- Nan Zhao, Matthew Aldrich, Christoph F Reinhart, and Joseph A Paradiso. 2015. A Multidimensional Continuous Contextual Lighting Control System Using Google Glass. In Proceedings of the 2nd ACM International Conference on Embedded Systems for Energy-Efficient Built Environments. ACM, 235--244. Google ScholarDigital Library
Index Terms
- Mediated Atmospheres: A Multimodal Mediated Work Environment
Recommendations
Ubiquitous emotion-aware computing
Emotions are a crucial element for personal and ubiquitous computing. What to sense and how to sense it, however, remain a challenge. This study explores the rare combination of speech, electrocardiogram, and a revised Self-Assessment Mannequin to ...
Stressful first impressions in job interviews
ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal InteractionStress can impact many aspects of our lives, such as the way we interact and work with others, or the first impressions that we make. In the past, stress has been most commonly assessed through self-reported questionnaires; however, advancements in ...
The Perceived Emotion of Isolated Synthetic Audio: The EmoSynth Dataset and Results
AM '18: Proceedings of the Audio Mostly 2018 on Sound in Immersion and EmotionThe ability of sound to enhance human wellbeing has been known since ancient civilisations, and methods can be found today across domains of health and within a variety of cultures. There are an abundance of sound-based methods which show benefits for ...
Comments