FingOrbits: interaction with wearables using synchronized thumb movements

ABSTRACT

We present FingOrbits, a wearable interaction technique using synchronized thumb movements. A thumb-mounted ring with an inertial measurement unit and a contact microphone are used to capture thumb movements when rubbing against the other fingers. Spectral information of the movements are extracted and fed into a classification backend that facilitates gesture discrimination. FingOrbits enables up to 12 different gestures through detecting three rates of movement against each of the four fingers. Through a user study with 10 participants (7 novices, 3 experts), we demonstrate that FingOrbits can distinguish up to 12 thumb gestures with an accuracy of 89% to 99% rendering the approach applicable for practical applications.

References

1. Chan, L., Chen, Y.-L., Hsieh, C.-H., Liang, R.-H., and Chen, B.-Y. Cyclopsring: Enabling whole-hand and context-aware interactions through a fisheye ring. In Proc. UIST (2015).
2. Chen, K.-Y., Lyons, K., White, S., and Patel, S. utrack: 3d input using two magnetic sensors. In Proc. UIST (2013).
3. Dhuliawala, M., Lee, J., Shimizu, J., Bulling, A., Kunze, K., Starner, T., and Woo, W. Smooth eye movement interaction using eog glasses. In Proc. ICMI (2016).
4. Esteves, A., Velloso, E., Bulling, A., and Gellersen, H. Orbits: Gaze interaction for smart watches using smooth pursuit eye movements. In Proc. UIST (2015).
5. Huang, D.-Y., Chan, L., Yang, S., Wang, F., Liang, R.-H., Yang, D.-N., Hung, Y.-P., and Chen, B.-Y. Digitspace: Designing thumb-to-fingers touch interfaces for one-handed and eyes-free interactions. In Proc. CHI (2016).
6. Kim, D., Hilliges, O., Izadi, S., Butler, A. D., Chen, J., Oikonomidis, I., and Olivier, P. Digits: freehand 3d interactions anywhere using a wrist-worn gloveless sensor. In Proc. UIST (2012).
7. Loclair, C., Gustafson, S., and Baudisch, P. Pinchwatch: a wearable device for one-handed microinteractions. In Proc. MobileHCI (2010).
8. Tsai, H.-R., Wu, C.-Y., Huang, L.-T., and Hung, Y.-P. Thumbring: private interactions using one-handed thumb motion input on finger segments. In Adjunct Proc. MobileHCI (2016).
9. Zhang, C., Waghmare, A., Kundra, P., Pu, Y., Gilliland, S., Ploetz, T., Starner, T., Inan, O., and Abowd, G. Fingersound: Recognizing unistroke thumb gestures using a ring. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. (September, 2017).
10. Zhang, C., Xue, Q., Waghmare, A., Jain, S., Pu, Y., Hersek, S., Lyons, K., Cunefare, K. A., Inan, O. T., and Abowd, G. D. Soundtrak: Continuous 3d tracking of a finger using active acoustics. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 2 (June 2017), 30:1--30:25.

Index Terms

• Human-centered computing