Yong-Xiang Wang
ABSTRACT
In this demo, we present a Kinect-based interactive game which provides patients of facial palsy with a better and more fun way to perform facial physical therapy. By letting the user get scores when he/she bites or licks the virtual foods falling from the sky, the game goads the user into exercising their facial muscles. A robust bite action detector and an efficient tip-of-tongue locating method are developed to realize this game. Based on the head pose estimated by the depth clue, we classify the face orientation and locate the mouth region in each frame. The movements of lips are measured to detect the bite action, and different strategies are designed to more accurately detect the tip-of-tongue for various face orientations. The experimental results show that our method can be successfully applied to different users.
- Nadine, P. C., John A.R., Hao W., Michelle A. J., Laura M., Keith K. 2009. Effect of tongue exercise on protrusive force and muscle fiber area in aging rats. Journal of Speech, Language, and Hearing Research. 52 (June 2009), 732--744.Google Scholar
- Ren W. H., Ao H. W., Lin Q., Xu Z.G., Zhang B. 2013. Efficacy of mouth opening exercises in treating trismus after maxillectomy. Chinese Medical Journal. 126, 14 (Jul. 2013), 2666--2669.Google Scholar
- Robbins, J., Kays S.A., Gangnon R.E., Hind J.A., Hewitt A.L., Gentry L.R., Taylor A.J. 2007. The effects of lingual exercise in stroke patients with dysphagia. Archives of Physical Medicine and Rehabilitation. 88, 2 (Feb. 2007), 150--158.Google ScholarCross Ref
- Kothari M., Svensson P., Jensen J., Holm T. D., Nielsen M. S., Mosegaard T., Nielsen J. F., Ghovanloo M., Baad-Hansen L. 2014. Tongue-controlled computer game: a new approach for rehabilitation of tongue motor function. Archives of Physical Medicine and Rehabilitation. 95, 3 (Mar. 2014), 524--530.Google ScholarCross Ref
- Xueliang H., Ghovanloo M. 2012. Tongue drive: a wireless tongue- operated means for people with severe disabilities to communicate their intentions. IEEE Communications Magazine. 50, 10 (Oct. 2012), 128--135.Google Scholar
- Windows SDK for Kinect - Face tracking: http://msdn.microsoft.com/en-us/library/jj130970.aspxGoogle Scholar
- Tip-of-tongue detection: http://tangochen.com/blog/?p=450Google Scholar
Index Terms
- Eat as much as you can: a kinect-based facial rehabilitation game based on mouth and tongue movements
Recommendations
RGB-D face recognition under various conditions via 3D constrained local model
Display Omitted Proposing a method for 3D face recognition using the affordable sensor Kinect.Aligning the face images using 3D constrained local model (CLM-Z).Eliminating irrelevant data by finding face landmarks and computing feature descriptors for ...
Facial Expression-Aware Face Frontalization
Computer Vision – ACCV 2016AbstractFace frontalization is a rising technique for view-invariant face analysis. It enables a non-frontal facial image to recover its general facial appearances to frontal view. A few pioneering works have been proposed very recently. However, face ...
Continuous Emotion Recognition in Videos by Fusing Facial Expression, Head Pose and Eye Gaze
ICMI '19: 2019 International Conference on Multimodal InteractionContinuous emotion recognition is of great significance in affective computing and human-computer interaction. Most of existing methods for video based continuous emotion recognition utilize facial expression. However, besides facial expression, other ...
Comments