Katsutoshi Masai
Kai Kunze
ABSTRACT
In this paper, we describe Empathy Glasses, a head worn prototype designed to create an empathic connection between remote collaborators. The main novelty of our system is that it is the first to combine the following technologies together: (1) wearable facial expression capture hardware, (2) eye tracking, (3) a head worn camera, and (4) a see-through head mounted display, with a focus on remote collaboration. Using the system, a local user can send their information and a view of their environment to a remote helper who can send back visual cues on the local user's see-through display to help them perform a real world task. A pilot user study was conducted to explore how effective the Empathy Glasses were at supporting remote collaboration. We describe the implications that can be drawn from this user study.
- Heinz L Ansbacher and Rowena R Ansbacher. 1956. The individual psychology of Alfred Adler. (1956).Google Scholar
- Martin Bauer, Gerd Kortuem, and Zary Segall. 1999. "Where Are You Pointing At?" A Study of Remote Collaboration in a Wearable Video conference System. In Proceedings of the 3rd IEEE International Symposium on Wearable Computers (ISWC '99). IEEE Computer Society, Washington, DC, USA, 151-. http://dl.acm.org/citation.cfm?id=519309.856501 Google ScholarDigital Library
- R.A. Calvo and S. D'Mello. 2010. Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications. Affective Computing, IEEE Transactions on 1, 1 (Jan 2010), 18-37. DOI: http://dx.doi.org/10.1109/T-AFFC.2010.1 Google ScholarDigital Library
- EPSON. 2014. Moverio BT-200. Website. (2014). http://www.epson.com/moverioGoogle Scholar
- Susan R. Fussell, Robert E. Kraut, and Jane Siegel. 2000. Coordination of Communication: Effects of Shared Visual Context on Collaborative Work. In Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work (CSCW '00). ACM, New York, NY, USA, 21-30. DOI: http://dx.doi.org/10.1145/358916.358947 Google ScholarDigital Library
- Susan R. Fussell, Leslie D. Setlock, and Robert E. Kraut. 2003. Effects of Head-mounted and Scene-oriented Video Systems on Remote Collaboration on Physical Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 513-520. DOI: http://dx.doi.org/10.1145/642611.642701 Google ScholarDigital Library
- Anders Henrysson, Mark Billinghurst, and Mark Ollila. 2005. Face to Face Collaborative AR on Mobile Phones. In Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR '05). IEEE Computer Society, Washington, DC, USA, 80-89. DOI: http://dx.doi.org/10.1109/ISMAR.2005.32 Google ScholarDigital Library
- Moritz Kassner, William Patera, and Andreas Bulling. 2014. Pupil: An Open Source Platform for Pervasive Eye Tracking and Mobile Gaze-based Interaction. (April 2014). http://arxiv.org/abs/1405.0006Google ScholarDigital Library
- Katsutoshi Masai, Yuta Sugiura, Masa Ogata, Katsuhiro Suzuki, Fumihiko Nakamura, Sho Shimamura, Kai Kunze, Masahiko Inami, and Maki Sugimoto. 2015. Affective Wear: Toward Recognizing Facial Expression. In ACM SIGGRAPH 2015 Emerging Technologies (SIGGRAPH '15). ACM, New York, NY, USA, Article 4, 1 pages. DOI: http://dx.doi.org/10.1145/2782782.2792495 Google ScholarDigital Library
- G Molinari, G Chanel, M Bétrancourt, T Pun, and C Bozelle. 2013. Emotion Feedback during Computer-Mediated Collaboration: Effects on Self-Reported Emotions and Perceived Interaction. In 10th International Conference on Computer Supported Collaborative Learning. Madison, Wisconsin, USA.Google Scholar
- Rosalind W. Picard. 1997. Affective Computing. MIT Press, Cambridge, MA, USA. Google ScholarDigital Library
- Eva-Lotta Sallnäs. 2005. Effects of communication mode on social presence, virtual presence, and performance in collaborative virtual environments. Presence - Teleoperators and Virtual Environments 14, 4 (2005), 434-449. QC 20100630. Google ScholarDigital Library
- Splashtop. 2015. Splashtop. Website. (2015). http://www.splashtop.com/personalGoogle Scholar
- Chiew Seng Sean Tan, Kris Luyten, Jan Van Den Bergh, Johannes Schöning, and Karin Coninx. 2014. The Role of Physiological Cues During Remote Collaboration. Presence: Teleoper. Virtual Environ. 23, 1 (Feb. 2014), 90-107. DOI: http://dx.doi.org/10.1162/PRES_a_00168 Google ScholarDigital Library
- Ulises Xolocotzin Eligio, Shaaron E. Ainsworth, and Charles K. Crook. 2012. Emotion Understanding and Performance During Computer-supported Collaboration. Comput. Hum. Behav. 28, 6 (Nov. 2012), 2046- 2054. DOI: http://dx.doi.org/10.1016/j.chb.2012.06.001 Google ScholarDigital Library
Index Terms
- Empathy Glasses
Recommendations
A User Study on Mixed Reality Remote Collaboration with Eye Gaze and Hand Gesture Sharing
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing SystemsSupporting natural communication cues is critical for people to work together remotely and face-to-face. In this paper we present a Mixed Reality (MR) remote collaboration system that enables a local worker to share a live 3D panorama of his/her ...
Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsWe present Mini-Me, an adaptive avatar for enhancing Mixed Reality (MR) remote collaboration between a local Augmented Reality (AR) user and a remote Virtual Reality (VR) user. The Mini-Me avatar represents the VR user's gaze direction and body gestures ...
CoVAR: a collaborative virtual and augmented reality system for remote collaboration
SA '17: SIGGRAPH Asia 2017 Emerging TechnologiesWe present CoVAR, a novel remote collaborative system combining Augmented Reality (AR), Virtual Reality (VR) and natural communication cues to create new types of collaboration. AR user can capture and share their local environment with a remote user in ...
Comments