FacePush: Introducing Normal Force on Face with Head-Mounted Displays

ABSTRACT

This paper presents FacePush, a Head-Mounted Display (HMD) integrated with a pulley system to generate normal forces on a user's face in virtual reality (VR). The mechanism of FacePush is obtained by shifting torques provided by two motors that press upon a user's face via utilization of a pulley system. FacePush can generate normal forces of varying strengths and apply those to the surface of the face. To inform our design of FacePush for noticeable and discernible normal forces in VR applications, we conducted two studies to iden- tify the absolute detection threshold and the discrimination threshold for users' perception. After further consideration in regard to user comfort, we determined that two levels of force, 2.7 kPa and 3.375 kPa, are ideal for the development of the FacePush experience via implementation with three applications which demonstrate use of discrete and continuous normal force for the actions of boxing, diving, and 360 guidance in virtual reality. In addition, with regards to a virtual boxing application, we conducted a user study evaluating the user experience in terms of enjoyment and realism and collected the user's feedback.

References

1. Kaan Akcsit, Ward Lopes, Jonghyun Kim, Josef Spjut, Anjul Patney, Peter Shirley, David Luebke, Steven A. Cholewiak, Pratul Srinivasan, Ren Ng, Martin S. Banks, and Gordon D. Love. 2017. Varifocal Virtuality: A Novel Optical Layout for Near-eye Display. In ACM SIGGRAPH 2017 Emerging Technologies (SIGGRAPH '17). ACM, New York, NY, USA, Article 25, 2 pages.
2. Kazuma Aoyama, Daiki Higuchi, Kenta Sakurai, Taro Maeda, and Hideyuki Ando. 2017. GVS RIDE: Providing a Novel Experience Using a Head Mounted Display and Four-pole Galvanic Vestibular Stimulation. In ACM SIGGRAPH 2017 Emerging Technologies (SIGGRAPH '17). ACM, New York, NY, USA, Article 9, 2 pages.
3. Kazuma Aoyama, Hiroyuki Iizuka, Hideyuki Ando, and Taro Maeda. 2015. Four-pole galvanic vestibular stimulation causes body sway about three axes. 5 (05 2015), 10168.
4. Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 717--728.
5. Matthias Berning, Florian Braun, Till Riedel, and Michael Beigl. 2015. ProximityHat: A Head-worn System for Subtle Sensory Augmentation with Tactile Stimulation. In Proceedings of the 2015 ACM International Symposium on Wearable Computers (ISWC '15). ACM, New York, NY, USA, 31--38.
6. V. A. de Jesus Oliveira, L. Brayda, L. Nedel, and A. Maciel. 2017. Experiencing guidance in 3D spaces with a vibrotactile head-mounted display. In 2017 IEEE Virtual Reality (VR). 453--454.
7. Alexandra Delazio, Ken Nakagaki, Roberta L. Klatzky, Scott E. Hudson, Jill Fain Lehman, and Alanson P. Sample. 2018. Force Jacket: Pneumatically-Actuated Jacket for Embodied Haptic Experiences. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 320, 12 pages.
8. Jan Gugenheimer, Dennis Wolf, Eythor R. Eiriksson, Pattie Maes, and Enrico Rukzio. 2016. GyroVR: Simulating Inertia in Virtual Reality Using Head Worn Flywheels. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 227--232.
9. Aakar Gupta, Antony Albert Raj Irudayaraj, and Ravin Balakrishnan. 2017. HapticClench: Investigating Squeeze Sensations Using Memory Alloys. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 109--117.
10. Da-Yuan Huang, Liwei Chan, Xiao-Feng Jian, Chiun-Yao Chang, Mu-Hsuan Chen, De-Nian Yang, Yi-Ping Hung, and Bing-Yu Chen. 2016. Vibroplay: Authoring Three-dimensional Spatial-temporal Tactile Effects with Direct Manipulation. In SIGGRAPH ASIA 2016 Emerging Technologies (SA '16). ACM, New York, NY, USA, Article 3, 2 pages.
11. L. A. Jones and H. Z. Tan. 2013. Application of Psychophysical Techniques to Haptic Research. IEEE Transactions on Haptics 6, 3 (July 2013), 268--284.
12. Oliver Beren Kaul and Michael Rohs. 2017. HapticHead: A Spherical Vibrotactile Grid Around the Head for 3D Guidance in Virtual and Augmented Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3729--3740.
13. Yuki Kon, Takuto Nakamura, and Hiroyuki Kajimoto. 2017. HangerOVER: HMD-embedded Haptics Display with Hanger Reflex. In ACM SIGGRAPH 2017 Emerging Technologies (SIGGRAPH '17). ACM, New York, NY, USA, Article 11, 2 pages.
14. Yuki Kon, Takuto Nakamura, Michi Sato, Takashi Asahi, and Hiroyuki Kajimoto. 2018. Hanger Reflex of the Head and Waist with Translational and Rotational Force Perception. In Haptic Interaction, Shoichi Hasegawa, Masashi Konyo, Ki-Uk Kyung, Takuya Nojima, and Hiroyuki Kajimoto (Eds.). Springer Singapore, Singapore, 217--223.
15. Robert Konrad, Emily A. Cooper, and Gordon Wetzstein. 2016. Novel Optical Configurations for Virtual Reality: Evaluating User Preference and Performance with Focus-tunable and Monovision Near-eye Displays. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1211--1220.
16. Marjorie R. Leek. 2001. Adaptive procedures in psychophysical research. Perception & Psychophysics 63, 8 (01 Nov 2001), 1279--1292.
17. Pedro Lopes, Alexandra Ion, and Patrick Baudisch. 2015. Impacto: Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, New York, NY, USA, 11--19.
18. Kouta Minamizawa, Souichiro Fukamachi, Hiroyuki Kajimoto, Naoki Kawakami, and Susumu Tachi. 2007. Gravity Grabber: Wearable Haptic Display to Present Virtual Mass Sensation. In ACM SIGGRAPH 2007 Emerging Technologies (SIGGRAPH '07). ACM, New York, NY, USA, Article 8.
19. Nitish Padmanaban, Robert Konrad, Tal Stramer, Emily A. Cooper, and Gordon Wetzstein. 2017. Optimizing virtual reality for all users through gaze-contingent and adaptive focus displays. Proceedings of the National Academy of Sciences 114, 9 (2017), 2183--2188.
20. Roshan Lalintha Peiris, Wei Peng, Zikun Chen, Liwei Chan, and Kouta Minamizawa. 2017. ThermoVR: Exploring Integrated Thermal Haptic Feedback with Head Mounted Displays. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5452--5456.
21. Henning Pohl, Peter Brandes, Hung Ngo Quang, and Michael Rohs. 2017. Squeezeback: Pneumatic Compression for Notifications. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5318--5330.
22. Nimesha Ranasinghe, Pravar Jain, Shienny Karwita, David Tolley, and Ellen Yi-Luen Do. 2017. Ambiotherm: Enhancing Sense of Presence in Virtual Reality by Simulating Real-World Environmental Conditions. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 1731--1742.
23. Michi Sato, Rika MATSUE, Yuki Hashimoto, and Hiroyuki Kajimoto. 2009. Development of a Head Rotation Interface by Using Hanger Reflex. In IEEE RO-MAN. 534--538.
24. Evan Strasnick, Christian Holz, Eyal Ofek, Mike Sinclair, and Hrvoje Benko. 2018. Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 644, 12 pages.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Haptic devices

    • Interaction paradigms

      • Virtual reality