Subtle Facial Expression Recognition Using Adaptive Magnification of Discriminative Facial Motion

ABSTRACT

Recently, recognizing spontaneous facial expression has gained increasing attention in various emerging applications related to human affect. Spontaneous facial expression may generally have different temporal characteristics across subjects, emotion types, and so on. In this paper, we proposed a facial expression recognition (FER) method which adaptively magnifies a subtle facial motion based on its temporal characteristics. In training stage, we learn the relations between the temporal characteristics of facial motions and their discriminative temporal filtering. The learned model is used to automatically predict the most discriminative temporal filtering that magnifies the subtle facial motion in a test sequence. Experimental result shows that the proposed FER using the adaptive motion magnification performed clearly better than FER using non-adaptive motion magnification as well as FER without motion magnification.

References

1. Z. Ambadar, J. W. Schooler, and J. F. Cohn. Deciphering the enigmatic face the importance of facial dynamics in interpreting subtle facial expressions. Psychological Science, 16(5):403--410, 2005.
2. C. J. Burges. A tutorial on support vector machines for pattern recognition. Data mining and knowledge discovery, 2(2):121--167, 1998.
3. A. K. Davison, M. H. Yap, N. Costen, K. Tan, C. Lansley, and D. Leightley. Micro-facial movements: An investigation on spatio-temporal descriptors. In Computer Vision-ECCV 2014 Workshops, pages 111--123. Springer, 2014.
4. S. Gogia and R. Liu. Motion magnification of facial micro-expressions. 2014.
5. S.-T. Liong, J. See, R. C.-W. Phan, A. C. Le Ngo, Y.-H. Oh, and K. Wong. Subtle expression recognition using optical strain weighted features. In Computer Vision-ACCV 2014 Workshops, pages 644--657. Springer, 2014.
6. S. Park and D. Kim. Subtle facial expression recognition using motion magnification. Pattern Recognition Letters, 30(7):708--716, 2009.
7. G. Sandbach, S. Zafeiriou, M. Pantic, and D. Rueck. A dynamic approach to the recognition of 3d facial expressions and their temporal models. In Automatic Face & Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on, pages 406--413. IEEE, 2011.
8. S. Wan and J. Aggarwal. Spontaneous facial expression recognition: A robust metric learning approach. Pattern Recognition, 47(5):1859--1868, 2014.
9. Y. Wang, J. See, R. C.-W. Phan, and Y.-H. Oh. Lbp with six intersection points: Reducing redundant information in lbp-top for micro-expression recognition. In Computer Vision--ACCV 2014, pages 525--537. Springer, 2015.
10. H.-Y. Wu, M. Rubinstein, E. Shih, J. V. Guttag, F. Durand, and W. T. Freeman. Eulerian video magnification for revealing subtle changes in the world. ACM Trans. Graph., 31(4):65, 2012.
11. W.-J. Yan, X. Li, S.-J. Wang, G. Zhao, Y.-J. Liu, Y.-H. Chen, and X. Fu. Casme ii: An improved spontaneous micro-expression database and the baseline evaluation. PloS one, 9(1), 2014.
12. W.-J. Yan, Q. Wu, J. Liang, Y.-H. Chen, and X. Fu. How fast are the leaked facial expressions: The duration of micro-expressions. Journal of Nonverbal Behavior, 37(4):217--230, 2013.
13. G. Zhao and M. Pietikainen. Dynamic texture recognition using local binary patterns with an application to facial expressions. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 29(6):915--928, 2007.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision tasks