3D touch point detection on load sensitive surface based on continuous fluctuation of a user hand

ABSTRACT

We present a load sensitive surface which provides exact contact position in 3D and a force vector of user's touch from low cost load sensors without any prior knowledge about shape of objects. Load based approach is advantageous since they provide a force vector, however, there have been mathematical ambiguity of the touch position along the line of action.

To address this problem, we develop algorithm based on pseudo-inverse matrix framework, utilizing the notion that user's hands are always fluctuating slightly and unconsciously during touch interaction. In this paper, we introduce the design space of the surface, outline of the algorithm and highlighted applications. This technique to localize the touch position in physical spaces enables us to design tangible interaction with inert everyday objects and analyze user's activities happening on the surfaces.

References

1. Charles Hudin, Sabrina Panëels, and Steven Strachan. 2016. INTACT: Instant Interaction with 3D Printed Objects. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHIEA '16). ACM, New York, NY, USA, 2719--2725.
2. Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI '97). ACM, New York, NY, USA, 234--241.
3. Makoto Ono, Buntarou Shizuki, and Jiro Tanaka. 2013. Touch & Activate: Adding Interactivity to Existing Objects Using Active Acoustic Sensing. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 31--40.
4. Munehiko Sato, Ivan Poupyrev, and Chris Harrison. 2012. Touche: Enhancing Touch Interaction on Humans, Screens, Liquids, and Everyday Objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 483--492.
5. Albrecht Schmidt, Martin Strohbach, Kristof van Laerhoven, and Gellersen Hans-W. 2003. Ubiquitous Interaction - Using Surfaces in Everyday Environments as Pointing Devices. In Universal Access Theoretical Perspectives, Practice, and Experience, Noëlle Carbonell and Constantine Stephanidis (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 263--279.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction techniques

      • Pointing

  • Ubiquitous and mobile computing

    • Ubiquitous and mobile computing systems and tools