Yasuaki Monnai
ABSTRACT
We present HaptoMime, a mid-air interaction system that allows users to touch a floating virtual screen with hands-free tactile feedback. Floating images formed by tailored light beams are inherently lacking in tactile feedback. Here we propose a method to superpose hands-free tactile feedback on such a floating image using ultrasound. By tracking a fingertip with an electronically steerable ultrasonic beam, the fingertip encounters a mechanical force consistent with the floating image. We demonstrate and characterize the proposed transmission scheme and discuss promising applications with an emphasis that it helps us 'pantomime' in mid-air.
Supplemental Material
- Annett, M., Grossman, T., Wigdor, D., and Fitzmaurice, G. Medusa: A Proximity-Aware Multitouch Tabletop. Proc. UIST, (2011), 337--346. Google Scholar
Digital Library
- ASUKANET co. ltd. http://www.asukanet.co.jpGoogle Scholar
- Benko, H., Jota, R., and Wilson, A.D. MirageTable: Freehand Interaction on a Projected Augmented Reality Tabletop. Proc. CHI, (2012), 199--208. Google ScholarDigital Library
- Butler, A., Hilliges, O., Izadi, S., Hodges, S., Molyneaux, D., Kim, D., and Kong, D. Vermeer: direct interaction with a 360° viewable 3D display. Proc. UIST, (2011), 569--579. Google ScholarDigital Library
- Carter, T., Seah, S.A., Long, B., Drinkwater, B., and Subramanian, S. UltraHaptics: multi-point mid-air haptic feedback for touch surfaces. Proc. UIST, (2013), 505--514. Google ScholarDigital Library
- Chan, L.W., Kao, H.S., Chen, M.Y., Lee, M.S., Hsu, J., and Hung, Y.P. Touching the Void: Direct-Touch Interaction for Intangible Displays. Proc. CHI, (2010), 2625--2634. Google ScholarDigital Library
- Hasegawa, K. and Shinoda, H. Aerial Display of Vibrotactile Sensation with High Spatial-Temporal Resolution using Large-Aperture Airborne Ultrasound Phased Array, Proc. IEEE World Haptics Conference, (2013), 31--36.Google ScholarCross Ref
- Hilliges, O., Kim, D., Izadi, S., Weiss, M., and Wilson, A.D. HoloDesk: direct 3d interactions with a situated see-through display. Proc. CHI, (2012), 24212430. Google ScholarDigital Library
- Hoshi, T., Takahashi, M., Nakatsuma, K., and Shinoda, H. Touchable holography. SIGGRAPH ETech, (2009), 23:1. Google ScholarDigital Library
- Hoshi, T., Takahashi, M., Iwamoto, T., and Shinoda, H. Noncontact tactile display based on radiation pressure of airborne ultrasound. IEEE Transactions on Haptics 3, 3 (2010), 155--165. Google ScholarDigital Library
- Iwamoto, T., Tatezono, M., and Shinoda, H. Noncontact method for producing tactile sensation using airborne ultrasound. Proc. EuroHaptics, SpringerVerlag (2008), 504--513. Google ScholarDigital Library
- Kane, S.K., Morris, M.R., Perkins, A.Z., Wigdor, D., Ladner, R.E., and Wobbrock, J.O. Access overlays: improving non-visual access to large touch screens for blind users. Proc. UIST, (2011), 273--282. Google ScholarDigital Library
- Maekawa, S., Nitta, K., and Matoba, O. Transmissive Optical Imaging Device with Micromirror Array. Proc. SPIE 6392 (2006), 63920E.Google ScholarCross Ref
- Maekawa, S. Floating touch display. 2nd Int. Symp. on Universal Communication., (2008).Google Scholar
- Markon, S., Maekawa, S., Onat, A., Zhibo, Z., and Miyake, H. Improved interaction methods for medical visualization with floating images, Proc. ICME, (2013), 462--466.Google ScholarCross Ref
- Marshall, M.T., Carter, T., Alexander, J., and Subramanian, S. Ultra-tangibles: creating movable tangible objects on interactive tables. Proc. CHI, (2012), 2185--2188. Google ScholarDigital Library
- Otsubo, M. Jpn. Unexamined Patent Publication No. 1997--5503 (1997).Google Scholar
- Rakkolainen, I. How Feasible Are Star Wars Mid-air Displays? Proc. Int. Conf. Information Visualization (2007), 935--942. Google ScholarDigital Library
- Sodhi, R., Poupyrev, I., Glisson, M., and Israr, A. AIREAL: Interactive Tactile Experiences in Free Air. Proc. SIGGRAPH, (2013), 134:1--10. Google ScholarDigital Library
- Suzuki, Y. and Kobayashi, M. Air Jet Driven Force Feedback in Virtual Reality. IEEE Comp. Graphics and Applications, 25, (2005), 44--47. Google ScholarDigital Library
- Wilson, G., Carter, T., Subramanian, S., and Brewster, S. Perception of Ultrasonic Haptic Feedback on the Hand: Localisation and Apparent Motion, Proc. CHI, (2014), 1133--1142. Google ScholarDigital Library
- Yamamoto, H. and Suyama, S. Aerial 3D LED displayby use of retroreflective sheeting, Proc SPIE 8648, (2013), 86480Q.Google Scholar
- Yoshino, K. and Shinoda, H. Visio-Acoustic Screen for Contactless Touch Interface with Tactile Sensation, Proc. IEEE World Haptics Conference, (2013), 419--423.Google ScholarCross Ref
Index Terms
- HaptoMime: mid-air haptic interaction with a floating virtual screen
Recommendations
Tangible Holographic 3D Objects with Virtual Touch
ITS '15: Proceedings of the 2015 International Conference on Interactive Tabletops & SurfacesThis poster describes the design of a display and interaction device that allows a natural mid-air manipulation and feedback of floating, true 3D objects. This so called virtual touch will create a natural feeling of manipulating and touching of the ...
Improving 3D-Editing Workflows via Acoustic Levitation
UIST '22 Adjunct: Adjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and TechnologyWe outline how to improve common 3D-editing workflows such as modeling or character animation by utilizing an acoustic levitation kit as an interactive 3D display. Our proposed system allows users to directly interact with models in 3D space and ...
Vulture: a mid-air word-gesture keyboard
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWord-gesture keyboards enable fast text entry by letting users draw the shape of a word on the input surface. Such keyboards have been used extensively for touch devices, but not in mid-air, even though their fluent gestural input seems well suited for ...
Comments