Hopping-Pong: Changing Trajectory of Moving Object Using Computational Ultrasound Force

ABSTRACT

Physically moving real objects via a computational force connects computers and the real world and has been applied to tangible interfaces and mid-air display. Many researchers have controlled only a stationary real object by computational force. On the other hand, controlling a moving object can expand the real space that is controllable by the computer. In this paper, we explore the potential of computational force from the viewpoint of changing the trajectory of a moving object. Changing the trajectory is the primitive model to control a moving object, and it is the technological challenge requiring high-speed measurement and non-contact force with high-spatial resolution. As a proof-of-concept, we introduce Hopping-Pong changing the trajectory of a flying Ping-Pong Ball (PPB) using ultrasound force. The result shows that Hopping-Pong changes the trajectory of a PPB 344 mm. We conclude that a computational force is capable of controlling a moving object in the real world. This research contributes to expanding the computationally controlled space with applications for augmented sports, HCI and factory automation.

References

1. Marco AB Andrade, Anne L Bernassau, and Julio C Adamowski. 2016. Acoustic levitation of a large solid sphere. Applied Physics Letters 109, 4 (2016), 044101.
2. Marco AB Andrade, Fábio TA Okina, Anne L Bernassau, and Julio C Adamowski. 2017. Acoustic levitation of an object larger than the acoustic wavelength. The Journal of the Acoustical Society of America 141, 6 (2017), 4148--4154.
3. Aaron Becker, Robert Sandheinrich, and Timothy Bretl. 2009. Automated manipulation of spherical objects in three dimensions using a gimbaled air jet. In 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 781--786.
4. Peter J Berkelman, Ralph L Hollis, and David Baraff. 1999. Interaction with a real time dynamic environment simulation using a magnetic levitation haptic interface device. In Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No. 99CH36288C), Vol. 4. IEEE, 3261--3266.
5. Tom Carter, Sue Ann Seah, Benjamin Long, Bruce Drinkwater, and Sriram Subramanian. 2013. UltraHaptics: multi-point mid-air haptic feedback for touch surfaces. In Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, 505--514.
6. Daniele Foresti, Majid Nabavi, Mirko Klingauf, Aldo Ferrari, and Dimos Poulikakos. 2013. Acoustophoretic contactless transport and handling of matter in air. Proceedings of the National Academy of Sciences 110, 31 (2013), 12549--12554.
7. Euan Freeman, Julie Williamson, Sriram Subramanian, and Stephen Brewster. 2018. Point-and-shake: selecting from levitating object displays. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 18.
8. Takuro Furumoto, Masahiro Fujiwara, Yasutoshi Makino, and Hiroyuki Shinoda. 2019a. BaLuna: Floating Balloon Screen Manipulated Using Ultrasound. In Proceedings of the 26th IEEE Conference on Virtual Reality and 3D User Interfaces. IEEE, 221.
9. Takuro Furumoto, Keisuke Hasegawa, Yasutoshi Makino, and Hiroyuki Shinoda. 2019b. Three-Dimensional Manipulation of a Spherical Object Using Ultrasound Plane Waves. IEEE Robotics and Automation Letters 4, 1 (2019), 81--88.
10. Takayuki Hoshi, Masafumi Takahashi, Takayuki Iwamoto, and Hiroyuki Shinoda. 2010. Noncontact tactile display based on radiation pressure of airborne ultrasound. IEEE Transactions on Haptics 3, 3 (2010), 155--165.
11. Seki Inoue, Yasutoshi Makino, and Hiroyuki Shinoda. 2016. Scalable architecture for airborne ultrasound tactile display. In International AsiaHaptics conference. Springer, 99--103.
12. Seki Inoue, Shinichi Mogami, Tomohiro Ichiyama, Akihito Noda, Yasutoshi Makino, and Hiroyuki Shinoda. 2019. Acoustical boundary hologram for macroscopic rigid-body levitation. The Journal of the Acoustical Society of America 145, 1 (2019), 328--337.
13. Hiroshi Ishii, Craig Wisneski, Julian Orbanes, Ben Chun, and Joe Paradiso. 1999. PingPongPlus: design of an athletic-tangible interface for computer-supported cooperative play. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 394--401.
14. Yuta Itoh, Yuichi Hiroi, Jiu Otsuka, Maki Sugimoto, Jason Orlosky, Kiyoshi Kiyokawa, and Gudrun Klinker. 2016a. Laplacian vision: augmenting motion prediction via optical see-through head-mounted displays and projectors. In ACM SIGGRAPH 2016 Emerging Technologies. ACM, 13.
15. Yuta Itoh, Jason Orlosky, Kiyoshi Kiyokawa, and Gudrun Klinker. 2016b. Laplacian vision: Augmenting motion prediction via optical see-through head-mounted displays. In Proceedings of the 7th Augmented Human International Conference 2016. ACM, 16.
16. BV Jayawant. 1981. Electromagnetic suspension and levitation. Reports on Progress in Physics 44, 4 (1981), 411.
17. Michinari Kono, Takayuki Hoshi, and Yasuaki Kakehi. 2014. Lapillus bug: Creature-like behaving particles based on interactive mid-air acoustic manipulation. In Proceedings of the 11th Conference on Advances in Computer Entertainment Technology. ACM, 34.
18. Jinha Lee, Rehmi Post, and Hiroshi Ishii. 2011. ZeroN: mid-air tangible interaction enabled by computer controlled magnetic levitation. In Proceedings of the 24th annual ACM symposium on User interface software and technology. ACM, 327--336.
19. Mark Marshall, Thomas Carter, Jason Alexander, and Sriram Subramanian. 2012. Ultra-tangibles: creating movable tangible objects on interactive tables. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2185--2188.
20. Asier Marzo, Richard McGeehan, Jess McIntosh, Sue Ann Seah, and Sriram Subramanian. 2015. Ghost touch: Turning surfaces into interactive tangible canvases with focused ultrasound. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces. ACM, 137--140.
21. Florian'Floyd' Mueller and Martin R Gibbs. 2007a. Building a table tennis game for three players. In Proceedings of the international conference on Advances in computer entertainment technology. ACM, 179--182.
22. Florian'Floyd' Mueller and Martin R Gibbs. 2007b. Evaluating a distributed physical leisure game for three players. In Proceedings of the 19th Australasian Conference on Computer-Human Interaction: Entertaining User Interfaces. ACM, 143--150.
23. Kei Nitta, Keita Higuchi, and Jun Rekimoto. 2014. HoverBall: augmented sports with a flying ball. In Proceedings of the 5th Augmented Human International Conference. ACM, 13.
24. Takuya Nojima, Ngoc Phuong, Takahiro Kai, Toshiki Sato, and Hideki Koike. 2015. Augmented dodgeball: an approach to designing augmented sports. In Proceedings of the 6th Augmented Human International Conference. ACM, 137--140.
25. Yoichi Ochiai, Takayuki Hoshi, and Jun Rekimoto. 2014a. Pixie dust: graphics generated by levitated and animated objects in computational acoustic-potential field. ACM Transactions on Graphics (TOG) 33, 4 (2014), 85.
26. Yoichi Ochiai, Takayuki Hoshi, and Jun Rekimoto. 2014b. Three-dimensional mid-air acoustic manipulation by ultrasonic phased arrays. PloS one 9, 5 (2014), e97590.
27. Yuta Sugiura, Koki Toda, Takayuki Hoshi, Youichi Kamiyama, Takeo Igarashi, and Masahiko Inami. 2014. Graffiti fur: turning your carpet into a computer display. In Proceedings of the 27th annual ACM symposium on User interface software and technology. ACM, 149--156.
28. Shun Suzuki, Ryoko Takahashi, Mitsuru Nakajima, Keisuke Hasegawa, Yasutoshi Makino, and Hiroyuki Shinoda. 2018. Midair Haptic Display to Human Upper Body. In 2018 57th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE). IEEE, 848--853.
29. Yuki Uno, Hao Qiu, Toru Sai, Shunta Iguchi, Yota Mizutani, Takayuki Hoshi, Yoshihiro Kawahara, Yasuaki Kakehi, and Makoto Takamiya. 2018. Luciola: A millimeter-scale light-emitting particle moving in mid-air based on acoustic levitation and wireless powering. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 4 (2018), 166.
30. Chi Thanh Vi, Asier Marzo, Damien Ablart, Gianluca Memoli, Sriram Subramanian, Bruce Drinkwater, and Marianna Obrist. 2017. Tastyfloats: A contactless food delivery system. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. ACM, 161--170.
31. RR Whymark. 1975. Acoustic field positioning for containerless processing. Ultrasonics 13, 6 (1975), 251--261.
32. Toshiya Yui and Tomoko Hashida. 2016. Floatio: Floating tangible user interface based on animacy perception. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 43--45.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices