Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality

ABSTRACT

Ungrounded haptic devices for virtual reality (VR) applications lack the ability to convincingly render the sensations of a grasped virtual object's rigidity and weight. We present Grabity, a wearable haptic device designed to simulate kinesthetic pad opposition grip forces and weight for grasping virtual objects in VR. The device is mounted on the index finger and thumb and enables precision grasps with a wide range of motion. A unidirectional brake creates rigid grasping force feedback. Two voice coil actuators create virtual force tangential to each finger pad through asymmetric skin deformation. These forces can be perceived as gravitational and inertial forces of virtual objects. The rotational orientation of the voice coil actuators is passively aligned with the real direction of gravity through a revolute joint, causing the virtual forces to always point downward. This paper evaluates the performance of Grabity through two user studies, finding promising ability to simulate different levels of weight with convincing object rigidity. The first user study shows that Grabity can convey various magnitudes of weight and force sensations to users by manipulating the amplitude of the asymmetric vibration. The second user study shows that users can differentiate different weights in a virtual environment using Grabity.

References

1. CyberGrasp, CyberGlove Systems Inc. http://www.cyberglovesystems.com/cybergrasp/. (????). Accessed: 2017-04-03.
2. Tomohiro Amemiya and Hiroaki Gomi. 2014. Distinct pseudo-attraction force sensation by a thumb-sized vibrator that oscillates asymmetrically. In International Conference on Human Haptic Sensing and Touch Enabled Computer Applications. Springer, 88--95.
3. Tomohiro Amemiya and Taro Maeda. 2008. Asymmetric oscillation distorts the perceived heaviness of handheld objects. IEEE Transactions on Haptics 1, 1 (2008), 9--18.
4. AA Amis. 1987. Variation of finger forces in maximal isometric grasp tests on a range of cylinder diameters. Journal of biomedical engineering 9, 4 (1987), 313--320.
5. Federico Barbagli, Kenneth Salisbury, and Roman Devengenzo. 2004. Toward virtual manipulation: from one point of contact to four. Sensor Review 24, 1 (2004), 51--59.
6. Karlin Bark, Jason Wheeler, Gayle Lee, Joan Savall, and Mark Cutkosky. 2009. A wearable skin stretch device for haptic feedback. In EuroHaptics conference, 2009 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics 2009. Third Joint. IEEE, 464--469.
7. Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 717--728.
8. Mourad Bouzit, Grigore Burdea, George Popescu, and Rares Boian. 2002. The Rutgers Master II-new design force-feedback glove. IEEE/ASME Transactions on mechatronics 7, 2 (2002), 256--263.
9. Francesco Chinello, Monica Malvezzi, Claudio Pacchierotti, and Domenico Prattichizzo. 2015. Design and development of a 3RRS wearable fingertip cutaneous device. In Advanced Intelligent Mechatronics (AIM), 2015 IEEE International Conference on. IEEE, 293--298.
10. Inrak Choi, Elliot W Hawkes, David L Christensen, Christopher J Ploch, and Sean Follmer. 2016. Wolverine: A wearable haptic interface for grasping in virtual reality. In Intelligent Robots and Systems (IROS), 2016 IEEE/RSJ International Conference on. IEEE, 986--993.
11. Tom N Cornsweet. 1962. The staircase-method in psychophysics. The American journal of psychology 75, 3 (1962), 485--491.
12. Heather Culbertson, Julie M Walker, and Allison M Okamura. 2016. Modeling and design of asymmetric vibrations to induce ungrounded pulling sensation through asymmetric skin displacement. In Haptics Symposium (HAPTICS), 2016 IEEE. IEEE, 27--33.
13. Heather Culbertson, Julie M Walker, Michael Raitor, and Allison M Okamura. 2017. WAVES: A Wearable Asymmetric Vibration Excitation System for Presenting Three-Dimensional Translation and Rotation Cues. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 4972--4982.
14. Takahiro Endo, Haruhisa Kawasaki, Tetsuya Mouri, Yasuhiko Ishigure, Hisayuki Shimomura, Masato Matsumura, and Kazumi Koketsu. 2011. Five-fingered haptic interface robot: HIRO III. IEEE Transactions on Haptics 4, 1 (2011), 14--27.
15. Xiaochi Gu, Yifei Zhang, Weize Sun, Yuanzhe Bian, Dao Zhou, and Per Ola Kristensson. 2016. Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1991--1995.
16. Sidhant Gupta, Tim Campbell, Jeffrey R Hightower, and Shwetak N Patel. 2010. SqueezeBlock: using virtual springs in mobile devices for eyes-free interaction. In Proceedings of the 23nd annual ACM symposium on User interface software and technology. ACM, 101--104.
17. Vincent Hayward and M Cruz-Hernandez. 2000. Tactile display device using distributed lateral skin stretch. In Proceedings of the haptic interfaces for virtual environment and teleoperator systems symposium, Vol. 69. ASME, 1309--1314.
18. James Houk and William Simon. 1967. Responses of Golgi tendon organs to forces applied to muscle tendon. Journal of neurophysiology 30, 6 (1967), 1466--1481.
19. Alexandra Ion, Edward Jay Wang, and Patrick Baudisch. 2015. Skin drag displays: Dragging a physical tactor across the user's skin produces a stronger tactile stimulus than vibrotactile. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2501--2504.
20. RS Johansson and G Westling. 1984. Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects. Experimental brain research 56, 3 (1984), 550--564.
21. Kenneth O Johnson. 2001. The roles and functions of cutaneous mechanoreceptors. Current opinion in neurobiology 11, 4 (2001), 455--461.
22. Lynette A Jones. 1986. Perception of force and weight: Theory and research. Psychological bulletin 100, 1 (1986), 29.
23. Rebecca Khurshid, Naomi Fitter, Elizabeth Fedalei, and Katherine Kuchenbecker. 2016. Effects of Grip-Force, Contact, and Acceleration Feedback on a Teleoperated Pick-and-Place Task. IEEE transactions on haptics (2016).
24. Katherine J Kuchenbecker, Jamie Gewirtz, William McMahan, Dorsey Standish, Paul Martin, Jonathan Bohren, Pierre J Mendoza, and David I Lee. 2010. VerroTouch: High-frequency acceleration feedback for telerobotic surgery. In International Conference on Human Haptic Sensing and Touch Enabled Computer Applications. Springer, 189--196.
25. Susan J Lederman and Roberta L Klatzky. 1987. Hand movements: A window into haptic object recognition. Cognitive psychology 19, 3 (1987), 342--368.
26. Christine L MacKenzie and Thea Iberall. 1994. The grasping hand. Vol. 104. Elsevier.
27. Thomas H Massie, J Kenneth Salisbury, and others. 1994. The phantom haptic interface: A device for probing virtual objects. In Proceedings of the ASME winter annual meeting, symposium on haptic interfaces for virtual environment and teleoperator systems, Vol. 55. Citeseer, 295--300.
28. William McMahan and Katherine J Kuchenbecker. 2014. Dynamic modeling and control of voice-coil actuators for high-fidelity display of haptic vibrations. In Haptics Symposium (HAPTICS), 2014 IEEE. IEEE, 115--122.
29. Kouta Minamizawa, Souichiro Fukamachi, Hiroyuki Kajimoto, Naoki Kawakami, and Susumu Tachi. 2007a. Gravity grabber: wearable haptic display to present virtual mass sensation. In ACM SIGGRAPH 2007 emerging technologies. ACM, 8.
30. Kouta Minamizawa, Hiroyuki Kajimoto, Naoki Kawakami, and Susumu Tachi. 2007b. A wearable haptic display to present the gravity sensation-preliminary observations and device design. In EuroHaptics Conference, 2007 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics 2007. Second Joint. IEEE, 133--138.
31. Jun Murayama, Laroussi Bougrila, YanLin Luo, Katsuhito Akahane, Shoichi Hasegawa, Béat Hirsbrunner, and Makoto Sato. 2004. SPIDAR G&G: a two-handed haptic interface for bimanual VR interaction. In Proceedings of EuroHaptics, Vol. 2004. 138--146.
32. Zoran Najdovski and Saeid Nahavandi. 2008. Extending haptic device capability for 3D virtual grasping. Haptics: perception, devices and scenarios (2008), 494--503.
33. Ryuma Niiyama, Lining Yao, and Hiroshi Ishii. 2014. Weight and volume changing device with liquid metal transfer. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction. ACM, 49--52.
34. Claudio Pacchierotti, Gionata Salvietti, Irfan Hussain, Leonardo Meli, and Domenico Prattichizzo. 2016. The hRing: A wearable haptic device to avoid occlusions in hand tracking. In Haptics Symposium (HAPTICS), 2016 IEEE. IEEE, 134--139.
35. Jérôme Pasquero and Vincent Hayward. 2003. STReSS: A practical tactile display system with one millimeter spatial resolution and 700 Hz refresh rate. In Proc. Eurohaptics, Vol. 2003. 94--110.
36. Christopher J Ploch, Jung Hwa Bae, Wendy Ju, and Mark Cutkosky. 2016. Haptic skin stretch on a steering wheel for displaying preview information in autonomous cars. In Intelligent Robots and Systems (IROS), 2016 IEEE/RSJ International Conference on. IEEE, 60--65.
37. William Provancher. 2014. Creating greater VR immersion by emulating force feedback with ungrounded tactile feedback. IQT Q 6, 2 (2014), 18--21.
38. William R Provancher and Nicholas D Sylvester. 2009. Fingerpad skin stretch increases the perception of virtual friction. IEEE Transactions on Haptics 2, 4 (2009), 212--223.
39. Zhan Fan Quek, Samuel B Schorr, Ilana Nisky, William R Provancher, and Allison M Okamura. 2015. Sensory substitution and augmentation using 3-degree-of-freedom skin deformation feedback. IEEE transactions on haptics 8, 2 (2015), 209--221.
40. Jun Rekimoto. 2014. Traxion: a tactile interaction device with virtual force sensation. In ACM SIGGRAPH 2014 Emerging Technologies. ACM, 25.
41. Samuel B Schorr and Allison M Okamura. 2017. Fingertip Tactile Devices for Virtual Object Manipulation and Exploration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 3115--3119.
42. Hong Z Tan, Xiao Dong Pang, Nathaniel I Durlach, and others. 1992. Manual resolution of length, force, and compliance. Advances in Robotics 42 (1992), 13--18.
43. Nikolaos G Tsagarakis, T Horne, and Darwin G Caldwell. 2005. Slip aestheasis: A portable 2d slip/skin stretch display for the fingertip. In Eurohaptics Conference, 2005 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2005. World Haptics 2005. First Joint. IEEE, 214--219.
44. Ernst Heinrich Weber, Helen Elizabeth Ross, and David J Murray. 1996. EH Weber on the tactile senses. Psychology Press.
45. Vibol Yem, Ryuta Okazaki, and Hiroyuki Kajimoto. 2016a. FinGAR: combination of electrical and mechanical stimulation for high-fidelity tactile presentation. In ACM SIGGRAPH 2016 Emerging Technologies. ACM, 7.
46. Vibol Yem, Ryuta Okazaki, and Hiroyuki Kajimoto. 2016b. Vibrotactile and pseudo force presentation using motor rotational acceleration. In Haptics Symposium (HAPTICS), 2016 IEEE. IEEE, 47--51.
47. André Zenner and Antonio Krüger. 2017. Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 23, 4 (2017), 1285--1294.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Haptic devices