Abstract
As one of the most successful applications of image analysis and understanding, face recognition has recently received significant attention, especially during the past several years. At least two reasons account for this trend: the first is the wide range of commercial and law enforcement applications, and the second is the availability of feasible technologies after 30 years of research. Even though current machine recognition systems have reached a certain level of maturity, their success is limited by the conditions imposed by many real applications. For example, recognition of face images acquired in an outdoor environment with changes in illumination and/or pose remains a largely unsolved problem. In other words, current systems are still far away from the capability of the human perception system.This paper provides an up-to-date critical survey of still- and video-based face recognition research. There are two underlying motivations for us to write this survey paper: the first is to provide an up-to-date review of the existing literature, and the second is to offer some insights into the studies of machine recognition of faces. To provide a comprehensive survey, we not only categorize existing recognition techniques but also present detailed descriptions of representative methods within each category. In addition, relevant topics such as psychophysical studies, system evaluation, and issues of illumination and pose variation are covered.
- Adini, Y., Moses, Y., and Ullman, S. 1997. Face recognition: The problem of compensating for changes in illumination direction. IEEE Trans. Patt. Anal. Mach. Intell. 19, 721--732.]] Google ScholarDigital Library
- Akamatsu, S., Sasaki, T., Fukamachi, H., Masui, N., and Suenaga, Y. 1992. An accurate and robust face identification scheme. In Proceedings, International Conference on Pattern Recognition. 217--220.]]Google Scholar
- Atick, J., Griffin, P., and Redlich, N. 1996. Statistical approach to shape from shading: Reconstruction of three-dimensional face surfaces from single two-dimensional images. Neural Computat. 8, 1321--1340.]]Google ScholarDigital Library
- Azarbayejani, A., Starner, T., Horowitz, B., and Pentland, A. 1993. Visually controlled graphics. IEEE Trans. Patt. Anal. Mach. Intell. 15, 602--604.]] Google ScholarDigital Library
- Bachmann, T. 1991. Identification of spatially quantized tachistoscopic images of faces: How many pixels does it take to carry identity? European J. Cog. Psych. 3, 87--103.]]Google ScholarCross Ref
- Bailly-Bailliere, E., Bengio, S., Bimbot, F., Hamouz, M., Kittler, J., Mariethoz, J., Matas, J., Messer, K., Popovici, V., Poree, F., Ruiz, B., and Thiran, J. P. 2003. The BANCA database and evaluation protocol. In Proceedings of the International Conference on Audio- and Video-Based Biometric Person Authentication. 625--638.]]Google Scholar
- Bartlett, J. C. and Searcy, J. 1993. Inversion and configuration of faces. Cog. Psych. 25, 281--316.]]Google ScholarCross Ref
- Bartlett, M. S., Lades, H. M., and Sejnowski, T. 1998. Independent component representation for face recognition. In Proceedings, SPIE Symposium on Electronic Imaging: Science and Technology. 528--539.]]Google Scholar
- Basri, R. and Jacobs, D. W. 2001. Lambertian refelectances and linear subspaces. In Proceedings, International Conference on Computer Vision. Vol. II. 383--390.]]Google Scholar
- Belhumeur, P. N., Hespanha, J. P., and Kriegman, D. J. 1997. Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection. IEEE Trans. Patt. Anal. Mach. Intell. 19, 711--720.]] Google ScholarDigital Library
- Belhumeur, P. N. and Kriegman, D. J. 1997. What is the set of images of an object under all possible lighting conditions? In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 52--58.]] Google ScholarDigital Library
- Bell, A. J. and Sejnowski, T. J. 1995. An information maximisation approach to blind separation and blind deconvolution. Neural Computation 7, 1129--1159.]] Google ScholarDigital Library
- Bell, A. J. and Sejnowski, T. J. 1997. The independent components of natural scenes are edge filters. Vis. Res. 37, 3327--3338.]]Google ScholarCross Ref
- Beveridge, J. R., She, K., Draper, B. A., and Givens, G. H. 2001. A nonparametric statisical comparison of principal component and linear discriminant subspaces for face recognition. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. (An updated version can be found online at http://www.cs.colostate.edu/evalfacerec/news.html.)]]Google Scholar
- Beymer, D. 1995. Vectorizing face images by interleaving shape and texture computations. MIT AI Lab memo 1537. Massachusetts Institute of Technology, Cambridge, MA.]] Google ScholarDigital Library
- Beymer, D. J. 1993. Face recognition under varying pose. Tech. Rep. 1461. MIT AI Lab, Massachusetts Institute of Technology, Cambridge, MA.]] Google ScholarDigital Library
- Beymer, D. J. and Poggio, T. 1995. Face recognition from one example view. In Proceedings, International Conference on Computer Vision. 500--507.]] Google ScholarDigital Library
- Biederman, I. 1987. Recognition by components: A theory of human image understanding. Psych. Rev. 94, 115--147.]]Google ScholarCross Ref
- Biederman, I. and Kalocsai, P. 1998. Neural and psychophysical analysis of object and face recognition. In Face Recognition: From Theory to Applications, H. Wechsler, P. J. Phillips, V. Bruce, F. F. Soulie, and T. S. Huang, Eds. Springer-Verlag, Berlin, Germany, 3--25.]]Google Scholar
- Bigun, J., Duc, B., Smeraldi, F., Fischer, S., and Makarov, A. 1998. Multi-modal person authentication. In Face Recognition: From Theory to Applications, H. Wechsler, P. J. Phillips, V. Bruce, F. F. Soulie, and T. S. Huang, Eds. Springer-Verlag, Berlin, Germany, 26--50.]]Google Scholar
- Black, M., Fleet, D., and Yacoob, Y. 1998. A Framework for modelling appearance change in image sequences. In Proceedings, International Conference on Computer Vision, 660--667.]] Google ScholarDigital Library
- Black, M. and Yacoob, Y. 1995. Tracking and recognizing facial expressions in image sequences using local parametrized models of image motion. Tech. rep. CS-TR-3401. Center for Automation Research, Unversity of Maryland, College Park, MD.]]Google Scholar
- Blackburn, D., Bone, M., and Phillips, P. J. 2001. Face recognition vendor test 2000. Tech. rep. http://www.frvt.org.]]Google Scholar
- Blanz, V. and Vetter, T. 1999. A Morphable model for the synthesis of 3D faces. In Proceedings, SIGGRAPH'99, 187--194.]] Google ScholarDigital Library
- Blanz, V. and Vetter, T. 2003. Face recognition based on fitting a 3D morphable model. IEEE Trans. Patt. Anal. Mach. Intell. 25, 1063--1074.]] Google ScholarDigital Library
- Bledsoe, W. W. 1964. The model method in facial recognition. Tech. rep. PRI:15, Panoramic research Inc., Palo Alto, CA.]]Google Scholar
- Brand, M. and Bhotika, R. 2001. Flexible flow for 3D nonrigid tracking and shape recovery. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition.]]Google Scholar
- Brennan, S. E. 1985. The caricature generator. Leonardo, 18, 170--178.]]Google ScholarCross Ref
- Bronstein, A., Bronstein, M., Gordon, E., and Kimmel, R. 2003. 3D face recognition using geometric invariants. In Proceedings, International Conference on Audio- and Video-Based Person Authentication.]]Google Scholar
- Bruce, V. 1988. Recognizing faces, Lawrence Erlbaum Associates, London, U.K.]]Google Scholar
- Bruce, V., Burton, M., and Dench, N. 1994. What's distinctive about a distinctive face? Quart. J. Exp. Psych. 47A, 119--141.]]Google ScholarCross Ref
- Bruce, V., Hancock, P. J. B., and Burton, A. M. 1998. Human face perception and identification. In Face Recognition: From Theory to Applications, H. Wechsler, P. J. Phillips, V. Bruce, F. F. Soulie, and T. S. Huang, Eds. Springer-Verlag, Berlin, Germany, 51--72.]]Google Scholar
- Bruner, I. S. and Tagiuri, R. 1954. The perception of people. In Handbook of Social Psychology, Vol. 2, G. Lindzey, Ed., Addison-Wesley, Reading, MA, 634--654.]]Google Scholar
- Buhmann, J., Lades, M., and Malsburg, C. v. d. 1990. Size and distortion invariant object recognition by hierarchical graph matching. In Proceedings, International Joint Conference on Neural Networks. 411--416.]]Google Scholar
- Chellappa, R., Wilson, C. L., and Sirohey, S. 1995. Human and machine recognition of faces: A survey. Proc. IEEE, 83, 705--740.]]Google ScholarCross Ref
- Choudhury, T., Clarkson, B., Jebara, T., and Pentland, A. 1999. Multimodal person recognition using unconstrained audio and video. In Proceedings, International Conference on Audio- and Video-Based Person Authentication. 176--181.]]Google Scholar
- Cootes, T., Taylor, C., Cooper, D., and Graham, J. 1995. Active shape models---their training and application. Comput. Vis. Image Understand. 61, 18--23.]] Google ScholarDigital Library
- Cootes, T., Walker, K., and Taylor, C. 2000. View-based active appearance models. In Proceedings, International Conference on Automatic Face and Gesture Recognition.]] Google ScholarDigital Library
- Cootes, T. F., Edwards, G. J., and Taylor, C. J. 2001. Active appearance models. IEEE Trans. Patt. Anal. Mach. Intell. 23, 681--685.]] Google ScholarDigital Library
- Cox, I. J., Ghosn, J., and Yianilos, P. N. 1996. Feature-based face recognition using mixture-distance. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 209--216.]] Google ScholarDigital Library
- Craw, I. and Cameron, P. 1996. Face recognition by computer. In Proceedings, British Machine Vision Conference. 489--507.]]Google Scholar
- Darwin, C. 1972. The Expression of the Emotions in Man and Animals. John Murray, London, U.K.]]Google Scholar
- DeCarlo, D. and Metaxas, D. 2000. Optical flow constraints on deformable models with applications to face tracking. Int. J. Comput. Vis. 38, 99--127.]] Google ScholarDigital Library
- Donato, G., Bartlett, M. S., Hager, J. C., Ekman, P., and Sejnowski, T. J. 1999. Classifying facial actions. IEEE Trans. Patt. Anal. Mach. Intell. 21, 974--989.]] Google ScholarDigital Library
- Edwards, G. J., Taylor, C. J., and Cootes, T. F. 1998. Learning to identify and track faces in image sequences. In Proceedings, International Conference on Automatic Face and Gesture Recognition.]] Google ScholarDigital Library
- Ekman, P. Ed., 1998. Charles Darwin's The Expression of the Emotions in Man and Animals, Third Edition, with Introduction, Afterwords and Commentaries by Paul Ekman. HarperCollins/Oxford University Press, New York, NY/London, U.K.]]Google Scholar
- Ellis, H. D. 1986. Introduction to aspects of face processing: Ten questions in need of answers. In Aspects of Face Processing, H. Ellis, M. Jeeves, F. Newcombe, and A. Young, Eds. Nijhoff, Dordrecht, The Netherlands, 3--13.]]Google Scholar
- Etemad, K. and Chellappa, R. 1997. Discriminant analysis for recognition of human face images. J. Opt. Soc. Am. A 14, 1724--1733.]]Google ScholarCross Ref
- Fisher, R. A. 1938. The statistical utilization of multiple measuremeents. Ann. Eugen. 8, 376--386.]]Google ScholarCross Ref
- Freeman, W. T. and Tenenbaum, J. B. 2000. Separating style and contents with bilinear models. Neural Computat. 12, 1247--1283.]] Google ScholarDigital Library
- Fukunaga, K. 1989. Statistical Pattern Recognition, Academic Press, New York, NY.]] Google ScholarDigital Library
- Galton, F. 1888. Personal identification and description. Nature, (June 21), 173--188.]]Google Scholar
- Gauthier, I., Behrmann, M., and Tarr, M. J. 1999. Can face recognition really be dissociated from object recognition? J. Cogn. Neurosci. 11, 349--370.]] Google ScholarDigital Library
- Gauthier, I. and Logothetis, N. K. 2000. Is face recognition so unique after All? J. Cogn. Neuropsych. 17, 125--142.]]Google ScholarCross Ref
- Georghiades, A. S., Belhumeur, P. N., and Kriegman, D. J. 1999. Illumination-based image synthesis: Creating novel images of human faces under differing pose and lighting. In Proceedings, Workshop on Multi-View Modeling and Analysis of Visual Scenes, 47--54.]] Google ScholarDigital Library
- Georghiades, A. S., Belhumeur, P. N., and Kriegman, D. J. 2001. From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Patt. Anal. Mach. Intell. 23, 643--660.]] Google ScholarDigital Library
- Georghiades, A. S., Kriegman, D. J., and Belhumeur, P. N. 1998. Illumination cones for recognition under variable lighting: Faces. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition, 52--58.]] Google ScholarDigital Library
- Ginsburg, A. G. 1978. Visual information processing based on spatial filters constrained by biological data. AMRL Tech. rep. 78--129.]]Google Scholar
- Gong, S., McKenna, S., and Psarrou, A. 2000. Dynamic Vision: From Images to Face Recognition. World Scientific, Singapore.]] Google ScholarDigital Library
- Gordon, G. 1991. Face recognition based on depth maps and surface curvature. In SPIE Proceedings, Vol. 1570: Geometric Methods in Computer Vision. SPIE Press, Bellingham, WA 234--247.]]Google Scholar
- Gu, L., Li, S. Z., and Zhang, H. J. 2001. Learning probabilistic distribution model for multiview face dectection. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition.]]Google Scholar
- Hager, G. D., and Belhumeur, P. N. 1998. Efficient region tracking with parametri models of geometry and illumination. IEEE Trans. Patt. Anal. Mach. Intell. 20, 1--15.]] Google ScholarDigital Library
- Hallinan, P. W. 1991. Recognizing human eyes. In SPIE Proceedings, Vol. 1570: Geometric Methods In Computer Vision. 214--226.]]Google Scholar
- Hallinan, P. W. 1994. A low-dimensional representation of human faces for arbitrary lighting conditions. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 995--999.]]Google ScholarCross Ref
- Hancock, P., Bruce, V., and Burton, M. 1998. A comparison of two computer-based face recognition systems with human perceptions of faces. Vis. Res. 38, 2277--2288.]]Google ScholarCross Ref
- Harmon, L. D. 1973. The recognition of faces. Sci. Am. 229, 71--82.]]Google Scholar
- Heisele, B., Serre, T., Pontil, M., and Poggio, T. 2001. Component-based face detection. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition.]]Google Scholar
- Hill, H. and Bruce, V. 1996. Effects of lighting on matching facial surfaces. J. Exp. Psych.: Human Percept. Perform. 22, 986--1004.]]Google ScholarCross Ref
- Hill, H., Schyns, P. G., and Akamatsu, S. 1997. Information and viewpoint dependence in face recognition. Cognition 62, 201--222.]]Google ScholarCross Ref
- Hjelmas, E. and Low, B. K. 2001. Face detection: A Survey. Comput. Vis. Image Understand. 83, 236--274.]]Google ScholarDigital Library
- Horn, B. K. P. and Brooks, M. J. 1989. Shape from Shading. MIT Press, Cambridge, MA.]] Google ScholarDigital Library
- Huang, J., Heisele, B., and Blanz, V. 2003. Component-based face recognition with 3D morphable models. In Proceedings, International Conference on Audio- and Video-Based Person Authentication.]]Google Scholar
- Isard, M. and Blake, A. 1996. Contour tracking by stochastic propagation of conditional density. In Proceedings, European Conference on Computer Vision.]] Google ScholarDigital Library
- Jacobs, D. W., Belhumeur, P. N., and Basri, R. 1998. Comparing images under variable illumination. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 610--617.]] Google ScholarDigital Library
- Jebara, T., Russel, K., and Pentland, A. 1998. Mixture of eigenfeatures for real-time structure from texture. Tech. rep. TR-440, MIT Media Lab, Massachusetts Institute of Technology, Cambridge, MA.]]Google Scholar
- Johnston, A., Hill, H., and Carman, N. 1992. Recognizing faces: Effects of lighting direction, inversion and brightness reversal. Cognition 40, 1--19.]]Google Scholar
- Kalocsai, P. K., Zhao, W., and Elagin, E. 1998. Face similarity space as perceived by humans and artificial systems. In Proceedings, International Conference on Automatic Face and Gesture Recognition. 177--180.]] Google ScholarDigital Library
- Kanade, T. 1973. Computer recognition of human faces. Birkhauser, Basel, Switzerland, and Stuttgart, Germany.]]Google Scholar
- Kelly, M. D. 1970. Visual identification of people by computer. Tech. rep. AI-130, Stanford AI Project, Stanford, CA.]]Google Scholar
- Kirby, M. and Sirovich, L. 1990. Application of the Karhunen-Loeve procedure for the characterization of human faces. IEEE Trans. Patt. Anal. Mach. Intell. 12.]] Google ScholarDigital Library
- Klasen, L. and Li, H. 1998. Faceless identification. In Face Recognition: From Theory to Applications, H. Wechsler, P. J. Phillips, V. Bruce, F. F. Soulie, and T. S. Huang, Eds. Springer-Verlag, Berlin, Germany, 513--527.]]Google Scholar
- Knight, B. and Johnston, A. 1997. The role of movement in face recognition. Vis. Cog. 4, 265--274.]]Google ScholarCross Ref
- Kruger, N., Potzsch, M., and Malsburg, C. v. d. 1997. Determination of face position and pose with a learned representation based on labelled graphs. Image Vis. Comput. 15, 665--673.]]Google ScholarCross Ref
- Kung, S. Y. and Taur, J. S. 1995. Decision-based neural networks with signal/image classification applications. IEEE Trans. Neural Netw. 6, 170--181.]]Google ScholarCross Ref
- Lades, M., Vorbruggen, J., Buhmann, J., Lange, J., Malsburg, C. v.d., Wurtz, R., and Konen, W. 1993. Distortion invariant object recognition in the dynamic link architecture. IEEE Trans. Comput. 42, 300--311.]] Google ScholarDigital Library
- Lanitis, A., Taylor, C. J., and Cootes, T. F. 1995. Automatic face identification system using flexible appearance models. Image Vis. Comput. 13, 393--401.]]Google ScholarCross Ref
- Lawrence, S., Giles, C. L., Tsoi, A. C., and Back, A. D. 1997. Face recognition: A convolutional neural-network approach. IEEE Trans. Neural Netw. 8, 98--113.]]Google ScholarDigital Library
- Li, B. and Chellappa, R. 2001. Face verification through tracking facial features. J. Opt. Soc. Am. 18.]]Google ScholarCross Ref
- Li, S. Z. and Lu, J. 1999. Face recognition using the nearest feature line method. IEEE Trans. Neural Netw. 10, 439--443.]]Google ScholarDigital Library
- Li, Y., Gong, S., and Liddell, H. 2001a. Constructing facial identity surfaces in a nonlinear discriminating space. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition.]]Google Scholar
- Li, Y., Gong, S., and Liddell, H. 2001b. Modelling face dynamics across view and over time. In Proceedings, International Conference on Computer Vision.]]Google Scholar
- Lin, S. H., Kung, S. Y., and Lin, L. J. 1997. Face recognition/detection by probabilistic decision-based neural network. IEEE Trans. Neural Netw. 8, 114--132.]]Google ScholarDigital Library
- Liu, C. and Wechsler, H. 2000a. Evolutionary pursuit and its application to face recognition. IEEE Trans. Patt. Anal. Mach. Intell. 22, 570--582.]] Google ScholarDigital Library
- Liu, C. and Wechsler, H. 2000b. Robust coding scheme for indexing and retrieval from large face databases. IEEE Trans. Image Process. 9, 132--137.]]Google ScholarDigital Library
- Liu, C. and Wechsler, H. 2001. A shape- and texture-based enhanced fisher classifier for face recognition. IEEE Trans. Image Process. 10, 598--608.]]Google ScholarDigital Library
- Liu, J. and Chen, R. 1998. Sequential Monte Carlo methods for dynamic systems. J. Am. Stat. Assoc. 93, 1031--1041.]]Google ScholarCross Ref
- Manjunath, B. S., Chellappa, R., and Malsburg, C. v. d. 1992. A feature based approach to face recognition. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 373--378.]]Google Scholar
- Marr, D. 1982. Vision. W. H. Freeman, San Francisco, CA.]]Google Scholar
- Martinez, A. 2002. Recognizing imprecisely localized, partially occluded and expression variant faces from a single sample per class. IEEE Trans. Patt. Anal. Mach. Intell. 24, 748--763.]] Google ScholarDigital Library
- Martinez, A. and Kak, A. C. 2001. PCA versus LDA. IEEE Trans. Patt. Anal. Mach. Intell. 23, 228--233.]] Google ScholarDigital Library
- Maurer, T. and Malsburg, C. v. d. 1996a. Single-view based recognition of faces rotated in depth. In Proceedings, International Workshop on Automatic Face and Gesture Recognition. 176--181.]]Google Scholar
- Maurer, T. and Malsburg, C. v. d. 1996b. Tracking and learning graphs and pose on image sequences of faces. In Proceedings, International Conference on Automatic Face and Gesture Recognition. 176--181.]] Google ScholarDigital Library
- McKenna, S. J. and Gong, S. 1997. Non-intrusive person authentication for access control by visual tracking and face recognition. In Proceedings, International Conference on Audio- and Video-Based Person Authentication. 177--183.]] Google ScholarDigital Library
- McKenna, S. and Gong, S. 1998. Recognising moving faces. In Face Recognition: From Theory to Applications, H. Wechsler, P. J. Phillips, V. Bruce, F. F. Soulie, and T. S. Huang, Eds. Springer-Verlag, Berlin, Germany, 578--588.]]Google Scholar
- Matas, J. et. al., 2000. Comparison of face verification results on the XM2VTS database. In Proceedings, International Conference on Pattern Recognition, Vol. 4, 858--863.]] Google ScholarDigital Library
- Messer, K., Matas, J., Kittler, J., Luettin, J., and Maitre, G. 1999. XM2VTSDB: The Extended M2VTS Database. In Proceedings, International Conference on Audio- and Video-Based Person Authentication. 72--77.]]Google Scholar
- Mika, S., Ratsch, G., Weston, J., Scholkopf, B., and Muller, K.-R. 1999. Fisher discriminant analysis with kernels. In Proceedings, IEEE Workshop on Neural Networks for Signal Processing.]]Google Scholar
- Moghaddam, B., Nastar, C., and Pentland, A. 1996. A Bayesian similarity measure for direct image matching. In Proceedings, International Conference on Pattern Recognition.]] Google ScholarDigital Library
- Moghaddam, B. and Pentland, A. 1997. Probabilistic visual learning for object representation. IEEE Trans. Patt. Anal. Mach. Intell. 19, 696--710.]] Google ScholarDigital Library
- Moon, H. and Phillips, P. J. 2001. Computational and performance aspects of PCA-based face recognition algorithms. Perception, 30, 301--321.]]Google ScholarCross Ref
- Murase, H. and Nayar, S. 1995. Visual learning and recognition of 3D objects from appearances. Int. J. Comput. Vis. 14, 5--25.]] Google ScholarDigital Library
- Nefian, A. V. and Hayes III, M. H. 1998. Hidden Markov models for face recognition. In Proceedings, International Conference on Acoustics, Speech and Signal Processing. 2721--2724.]]Google Scholar
- Okada, K., Steffans, J., Maurer, T., Hong, H., Elagin, E., Neven, H., and Malsburg, C. v. d. 1998. The Bochum/USC Face Recognition System and how it fared in the FERET Phase III Test. In Face Recognition: From Theory to Applications, H. Wechsler, P. J. Phillips, V. Bruce, F. F. Soulie, and T. S. Huang, Eds. Springer-Verlag, Berlin, Germany, 186--205.]]Google Scholar
- O'Toole, A. J., Roark, D., and Abdi, H. 2002. Recognitizing moving faces. A psychological and neural synthesis. Trends Cogn. Sci. 6, 261--266.]]Google ScholarCross Ref
- Pantic, M. and Rothkrantz, L. J. M. 2000. Automatic analysis of facial expressions: The state of the art. IEEE Trans. Patt. Anal. Mach. Intell. 22, 1424--1446.]] Google ScholarDigital Library
- Penev, P. and Sirovich, L. 2000. The global dimensionality of face space. In Proceedings, International Conference on Automatic Face and Gesture Recognition.]] Google ScholarDigital Library
- Penev, P. and Atick, J. 1996. Local feature analysis: A general statistical theory for objecct representation. Netw.: Computat. Neural Syst. 7, 477--500.]]Google ScholarCross Ref
- Pentland, A., Moghaddam, B., and Starner, T. 1994. View-based and modular eigenspaces for face recognition. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition.]]Google Scholar
- Perkins, D. 1975. A definition of caricature and recognition. Stud. Anthro. Vis. Commun. 2, 1--24.]]Google ScholarCross Ref
- Phillips, P. J., Grother, P. J., Micheals, R. J., Blackburn, D. M., Tabassi, E., and Bone, J. M. 2003. Face recognition vendor test 2002: Evaluation report. NISTIR 6965, 2003. Available online at http://www.frvt.org.]]Google Scholar
- Phillips, P. J. 1998. Support vector machines applied to face fecognition. Adv. Neural Inform. Process. Syst. 11, 803--809.]] Google ScholarDigital Library
- Phillips, P. J., McCabe, R. M., and Chellappa, R. 1998. Biometric image processing and recognition. In Proceedings, European Signal Processing Conference.]]Google Scholar
- Phillips, P. J., Moon, H., Rizvi, S., and Rauss, P. 2000. The FERET evaluation methodology for face-recognition algorithms. IEEE Trans. Patt. Anal. Mach. Intell. 22.]] Google ScholarDigital Library
- Phillips, P. J., Wechsler, H., Huang, J., and Rauss, P. 1998b. The FERET database and evaluation procedure for face-recognition algorithms. Image Vis. Comput. 16, 295--306.]]Google ScholarCross Ref
- Pigeon, S. and Vandendorpe, L. 1999. The M2VTS multimodal face database (Release 1.00). In Proceedings, International Conference on Audio- and Video-Based Person Authentication. 403--409.]] Google ScholarDigital Library
- Riklin-Raviv, T. and Shashua, A. 1999. The quotient image: Class based re-rendering and recognition with varying illuminations. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 566--571.]]Google Scholar
- Rizvi, S. A., Phillips, P. J., and Moon, H. 1998. A verification protocol and statistical performance analysis for face recognition algorithms. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 833--838.]] Google ScholarDigital Library
- Rowley, H. A., Baluja, S., and Kanade, T. 1998. Neural network based face detection. IEEE Trans. Patt. Anal. Mach. Intell. 20.]] Google ScholarDigital Library
- Choudhury, A. K. R. and Chellappa, R. 2003. Face reconstruction from monocular video using uncertainty analysis and a generic model. Comput. Vis. Image Understand. 91, 188--213.]] Google ScholarDigital Library
- Ruderman, D. L. 1994. The statistics of natural images. Netw.: Comput. Neural Syst. 5, 598--605.]]Google ScholarCross Ref
- Sali, E. and Ullman, S. 1998. Recognizing novel 3-D objects under new illumination and viewing position using a small number of example views or even a single view. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 153--161.]] Google ScholarDigital Library
- Samal, A. and Iyengar, P. 1992. Automatic recognition and analysis of human faces and facial expressions: A survey. Patt. Recog. 25, 65--77.]] Google ScholarDigital Library
- Samaria, F. 1994. Face recognition using hidden markov models. Ph.D. dissertation. University of Cambridge, Cambridge, U.K.]]Google Scholar
- Samaria, F. and Young, S. 1994. HMM based architecture for face identification. Image Vis. Comput. 12, 537--583.]]Google ScholarCross Ref
- Schneiderman, H. and Kanade, T. 2000. Probabilistic modelling of local Appearance and spatial reationships for object recognition. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition. 746--751.]] Google ScholarDigital Library
- Sergent, J. 1986. Microgenesis of face perception. In Aspects of Face Processing, H. D. Ellis, M. A. Jeeves, F. Newcombe, and A. Young, Eds. Nijhoff, Dordrecht, The Netherlands.]]Google Scholar
- Shashua, A. 1994. Geometry and photometry in 3D visual recognition. Ph.D. dissertation. Massachusetts Institute of Technology, Cambridge, MA.]] Google ScholarDigital Library
- Shepherd, J. W., Davies, G. M., and Ellis, H. D. 1981. Studies of cue saliency. In Perceiving and Remembering Faces, G. M. Davies, H. D. Ellis, and J. W. Shepherd, Eds. Academic Press, London, U.K.]]Google Scholar
- Shio, A. and Sklansky, J. 1991. Segmentation of people in motion. In Proceedings, IEEE Workshop on Visual Motion. 325--332.]]Google Scholar
- Sirovich, L. and Kirby, M. 1987. Low-dimensional procedure for the characterization of human face. J. Opt. Soc. Am. 4, 519--524.]]Google ScholarCross Ref
- Steffens, J., Elagin, E., and Neven, H. 1998. PersonSpotter---fast and robust system for human detection, tracking and recognition. In Proceedings, International Conference on Automatic Face and Gesture Recognition. 516--521.]] Google ScholarDigital Library
- Strom, J., Jebara, T., Basu, S., and Pentland, A. 1999. Real time tracking and modeling of faces: An EKF-based analysis by synthesis approach. Tech. rep. TR-506, MIT Media Lab, Massachusetts, Institute of Technology, Cambridge, MA.]]Google Scholar
- Sung, K. and Poggio, T. 1997. Example-based learning for view-based human face detection. IEEE Trans. Patt. Anal. Mach. Intell. 20, 39--51.]] Google ScholarDigital Library
- Swets, D. L. and Weng, J. 1996b. Using discriminant eigenfeatures for image retrieval. IEEE Trans. Patt. Anal. Mach. Intell. 18, 831--836.]] Google ScholarDigital Library
- Swets, D. L. and Weng, J. 1996. Discriminant analysis and eigenspace partition tree for face and object recognition from views. In Proceedings, International Conference on Automatic Face and Gesture Recognition. 192--197.]] Google ScholarDigital Library
- Tarr, M. J. and Bulthoff, H. H. 1995. Is human object recognition better described by geon structural descriptions or by multiple views---comment on Biederman and Gerhardstein (1993). J. Exp. Psych.: Hum. Percep. Perf. 21, 71--86.]]Google ScholarCross Ref
- Terzopoulos, D. and Waters, K. 1993. Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Trans. Patt. Anal. Mach. Intell. 15, 569--579.]] Google ScholarDigital Library
- Thompson, P. 1980. Margaret Thatcher---A new illusion. Perception, 9, 483--484.]]Google ScholarCross Ref
- Tsai, P. S. and Shah, M. 1994. Shape from shading using linear approximation. Image Vis. Comput. 12, 487--498.]]Google ScholarCross Ref
- Triggs, B., McLauchlan, P., Hartley, R., and Fitzgibbon, A. 2000. Bundle adjustment---a modern synthesis. In Vision Algorithms: Theory and Practice, Springer-Verlag, Berlin, Germany.]] Google ScholarDigital Library
- Turk, M. and Pentland, A. 1991. Eigenfaces for recognition. J. Cogn. Neurosci. 3, 72--86.]]Google ScholarDigital Library
- Ullman, S. and Basri, R. 1991. Recognition by linear combinations of models. IEEE Trans. Patt. Anal. Mach. Intell. 13, 992--1006.]] Google ScholarDigital Library
- Vapnik, V. N. 1995. The Nature of Statistical Learning Theory. Springer-Verlag, New York, NY.]] Google ScholarDigital Library
- Vetter, T. and Poggio, T. 1997. Linear object classes and image synthesis from a single example image. IEEE Trans. Patt. Anal. Mach. Intell. 19, 733--742.]] Google ScholarDigital Library
- Viola, P. and Jones, M. 2001. Rapid object detection using a boosted cascade of simple features. In Proceedings, IEEE Conference on Computer Vision and Pattern Recognition.]]Google Scholar
- Wechsler, H., Kakkad, V., Huang, J., Gutta, S., and Chen, V. 1997. Automatic video-based person authentication using the RBF network. In Proceedings, International Conference on Audio- and Video-Based Person Authentication. 85--92.]] Google ScholarDigital Library
- Wilder, J. 1994. Face recognition using transform coding of gray scale projection and the neural tree network. In Artificial Neural Networks with Applications in Speech and Vision, R. J. Mammone, Ed. Chapman Hall, New York, NY, 520--536.]]Google Scholar
- Wiskott, L., Fellous, J.-M., and von der Malsburg, C. 1997. Face recognition by elastic bunch graph matching. IEEE Trans. Patt. Anal. Mach. Intell. 19, 775--779.]] Google ScholarDigital Library
- Yang, M. H., Kriegman, D., and Ahuja, N. 2002. Detecting faces in images: A survey. IEEE Trans. Patt. Anal. Mach. Intell. 24, 34--58.]] Google ScholarDigital Library
- Yin, R. K. 1969. Looking at upside-down faces. J. Exp, Psych. 81, 141--151.]]Google ScholarCross Ref
- Yuille, A. L., Cohen, D. S., and Hallinan, P. W. 1992. Feature extractiong from faces using deformable templates. Int. J. Comput. Vis. 8, 99--112.]] Google ScholarDigital Library
- Yuille, A. and Hallinan, P. 1992. Deformable templates. In Active vision, A. Blake, and A. Yuille, Eds., Cambridge, MA, 21--38.]] Google ScholarDigital Library
- Zhao, W. 1999. Robust Image Based 3D Face Recognition, Ph.D. dissertation. University of Maryland, College Park, MD.]] Google ScholarDigital Library
- Zhao, W. and Chellappa, R. 2000b. SFS Based View synthesis for robust face recognition. In Proceedings, International Conference on Automatic Face and Gesture Recognition.]] Google ScholarDigital Library
- Zhao, W. and Chellappa, R. 2000. Illumination-insensitive face recognition using symmetric shape-from-shading. In Proceedings, Conference on Computer Vision and Pattern Recognition. 286--293.]]Google Scholar
- Zhao, W., Chellappa, R., and Krishnaswamy, A. 1998. Discriminant analysis of principal components for face recognition. In Proceedings, International Conference on Automatic Face and Gesture Recognition. 336--341.]] Google ScholarDigital Library
- Zhao, W., Chellappa, R., and Phillips, P. J. 1999. Subspace linear discriminant analysis for face recognition. Tech. rep. CAR-TR-914, Center for Automation Research, University of Maryland, College Park, MD.]]Google Scholar
- Zhou, S., Krueger, V., and Chellappa, R. 2003. Probabilistic recognition of human faces from video. Comput. Vis. Image Understand. 91, 214--245.]] Google ScholarDigital Library
Index Terms
- Face recognition: A literature survey
Recommendations
Age-Invariant Face Recognition
One of the challenges in automatic face recognition is to achieve temporal invariance. In other words, the goal is to come up with a representation and matching scheme that is robust to changes due to facial aging. Facial aging is a complex process that ...
Face recognition under varying illumination using gradientfaces
In this correspondence, we propose a novel method to extract illumination insensitive features for face recognition under varying lighting called the Gradientfaces. Theoretical analysis shows Gradientfaces is an illumination insensitive measure, and ...
Face Recognition Based Person Specific Identification for Video Surveillance Applications
WCI '15: Proceedings of the Third International Symposium on Women in Computing and InformaticsFace detection is an important aspect for applications like biometrics, video surveillance and human computer interaction. Videos provide abundant information and also that can be leveraged by temporal variations in pose, expression changes and ...
Comments