Leigh Ellen Potter
ABSTRACT
This paper presents an early exploration of the suitability of the Leap Motion controller for Australian Sign Language (Auslan) recognition. Testing showed that the controller is able to provide accurate tracking of hands and fingers, and to track movement. This detection loses accuracy when the hand moves into a position that obstructs the controller's ability to view, such as when the hand rotates and is perpendicular to the controller. The detection also fails when individual elements of the hands are brought together, such as finger to finger. In both of these circumstances, the controller is unable to read or track the hand. There is potential for the use of this technology for recognising Auslan, however further development of the Leap Motion API is required.
- GRI. 2008. "Regional and National Summary Report of Data from 2007--08 Annual Survey of Deaf and Hard of Hearing Children and Youth," Gallaudet Research Institute, Gallaudet University, Washington, DC.Google Scholar
- Holden, E.-J., and Owens, R. 2001. "Visual Sign Language Recognition," in Multi-Image Analysis, R. Klette, G. Gimel'farb and T. Huang (eds.). Springer Berlin Heidelberg, pp. 270--287. Google ScholarDigital Library
- Kadous, M. W. 1996. "Machine Recognition of Auslan Signs Using Powergloves: Towards Large-Lexicon Recognition of Sign Language," Workshop on the Integration of Gesture in Language and Speech, Delaware, US, pp. 165--174.Google Scholar
- Metz, R. 2013. "Leap Motion's Struggles Reveal Problems with 3-D Interfaces," in: MIT Technology Review. Cambridge, MA: MIT.Google Scholar
- Moeller, M. P. 2000. "Early Intervention and Language Development in Children Who Are Deaf and Hard of Hearing," Pediatrics (106:3), p. 10.Google Scholar
- Potter, L. E., Korte, J., and Nielsen, S. 2012. "Sign My World: Lessons Learned from Prototyping Sessions with Young Deaf Children," in: Proc. OZCHI 2012, ACM Press, pp. 501--504. Google ScholarDigital Library
- Vamplew, P., and Adams, A. 1998. "Recognition of Sign Language Gestures Using Neural Networks," Australian Journal of Intelligent Information Processing Systems (5:2), pp. 94--102.Google Scholar
Index Terms
- The Leap Motion controller: a view on sign language
Recommendations
Leap motion gesture based interface for learning environment by using leap motion
HCIK '15: Proceedings of HCI KoreaNUI(Natural User Interface) which means a natural user manipulation environment uses body as an input device by using a sensor, without using an input device such as a mouse or a keyboard. For these reasons, it has a feature that can be used easily as ...
Leap gestures for TV: insights from an elicitation study
TVX '14: Proceedings of the ACM International Conference on Interactive Experiences for TV and Online VideoWe present insights from a gesture elicitation study in the context of interacting with TV, during which 18 participants contributed and rated the execution difficulty and recall likeliness of free-hand gestures for 21 distinct TV tasks. Our study ...
Analysis of movement and gesture recognition using Leap Motion Controller
AbstractThe leap motion controller is an interactive tool used for gesture recognition and movement in various fields like medicine, manufacturing, 3D modeling etc. It uses cameras and infrared LEDs to track the movement of the hand. The gadget feels ...
Comments