Douglas Astler
ABSTRACT
Conversation between two individuals requires verbal dialogue; the majority of human communication however consists of non-verbal cues such as gestures and facial expressions. Blind individuals are thus hindered in their interaction capabilities. To address this, we are building a computer vision system with facial recognition and expression algorithms to relay nonverbal messages to a blind user. The device will communicate the identities and facial expressions of communication partners in realtime. In order to ensure that this device will be useful to the blind community, we conducted surveys and interviews and we are working with subjects to test prototypes of the device. This paper describes the algorithms and design concepts incorporated in this device, and it provides a commentary on early survey and interview results. A corresponding poster with demonstration stills is exhibited at this conference.
- Argyle, M. Salter, U. Nicholson, H. Williams, M. Burgess, P. The communication of inferior and superior attitudes by verbal and non-verbal signals. British Journal of Social Psychology, 9:222--231, 1970.Google Scholar
Cross Ref
- Friesen, W.V. Ekman, P. Constants across cultures in the face and emotion. Journal of Personality and Social Psychology, 17(2):124--129, 1971.Google ScholarCross Ref
- Little, G. Black, J. Panchanathan, S. Krishna, S. A wearable face recognition system for individuals with visual impairments. In 7th Annual ACM Conference on Assistive Technologies, pages 106--113, 2005. Google ScholarDigital Library
- Yacoob, Y. Black, M.J. Recognizing facial expressions in image sequences using local parameterized models of image motion. International Journal of Computer Vision, 25(1):23--48, 1997. Google ScholarDigital Library
- Yang, X.D. Xiao, Q. A facial presence monitoring system for information security. IEEE Workshop on Computational Intelligence in Biometrics, 2009.Google Scholar
Index Terms
- Increased accessibility to nonverbal communication through facial and expression recognition technologies for blind/visually impaired subjects
Recommendations
Integrated Expression-Invariant Face Recognition with Constrained Optical Flow
PSIVT '09: Proceedings of the 3rd Pacific Rim Symposium on Advances in Image and Video TechnologyFace recognition is one of the most intensively studied topics in computer vision and pattern recognition. A constrained optical flow algorithm, which combines the advantages of the unambiguous correspondence of feature point labeling and the flexible ...
Image ratio features for facial expression recognition application
Special issue on game theoryVideo-based facial expression recognition is a challenging problem in computer vision and human-computer interaction. To target this problem, texture features have been extracted and widely used, because they can capture image intensity changes raised ...
A Natural Visible and Infrared Facial Expression Database for Expression Recognition and Emotion Inference
To date, most facial expression analysis has been based on visible and posed expression databases. Visible images, however, are easily affected by illumination variations, while posed expressions differ in appearance and timing from natural ones. In ...
Comments