Junkang Zhang
ABSTRACT
Family photo recognition is an important task in social media analytics. Previous methods use singleton global features and conventional binary classifiers to distinguish family group photos from non-family ones. Different from them, we propose a novel family recognition approach with three dedicated local representations under Multiple Instance Learning framework, where geometry, kinship and semantic features are integrated to overcome issues in the previous work. Experimental results show that our method achieves the state-of-the-art result among global-feature models.
- Boris Babenko, Piotr Dollár, Zhuowen Tu, and Serge Belongie. 2008. Simultaneous Learning and Alignment: Multi-Instance and Multi-Pose Learning. In Workshop on Faces in 'Real-Life' Images: Detection, Alignment, and Recognition.Google Scholar
- T. Baltruaitis, P. Robinson, and L. P. Morency. 2016. Open- Face: An open source facial behavior analysis toolkit. In 2016 IEEE Winter Conference on Applications of Computer Vision (WACV). 1--10.Google Scholar
- Tianqi Chen and Carlos Guestrin. 2016. XGBoost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 785--794. Google ScholarDigital Library
- Yan-Ying Chen, Winston H. Hsu, and Hong-Yuan Mark Liao. 2012. Discovering Informative Social Subgraphs and Predicting Pairwise Relationships from Group Photos. In Proceedings of the 20th ACM International Conference on Multimedia. 669--678. Google ScholarDigital Library
- Adam Coates, Andrew Y Ng, and Honglak Lee. 2011. An analysis of single-layer networks in unsupervised feature learning. In International conference on artificial intelligence and statistics. 215--223.Google Scholar
- Jerome H. Friedman. 2001. Greedy Function Approximation: A Gradient Boosting Machine. The Annals of Statistics 29, 5 (2001), 1189--1232.Google ScholarCross Ref
- A. C. Gallagher and T. Chen. 2009. Understanding images of groups of people. In 2009 IEEE Conference on Computer Vision and Pattern Recognition. 256--263.Google Scholar
- Y. Guo, H. Dibeklioglu, and L. v. d. Maaten. 2014. Graph-Based Kinship Recognition. In 2014 22nd International Conference on Pattern Recognition. 4287--4292. Google ScholarDigital Library
- K. He, X. Zhang, S. Ren, and J. Sun. 2016. Deep Residual Learning for Image Recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 770--778.Google Scholar
- Thomas N Kipf and Max Welling. 2016. Semi-Supervised Clas- sification with Graph Convolutional Networks. arXiv preprint arXiv:1609.02907 (2016).Google Scholar
- Omkar M. Parkhi, Andrea Vedaldi, and Andrew Zisserman. 2015. Deep Face Recognition. In Proceedings of the British Machine Vision Conference (BMVC). Article 41, 41.1-41.12 pages.Google Scholar
- Joseph P Robinson, Ming Shao, Yue Wu, and Yun Fu. 2016. Families in the Wild (FIW): Large-Scale Kinship Image Database and Benchmarks. In Proceedings of the 2016 ACM on Multimedia Conference. ACM, 242--246. Google ScholarDigital Library
- Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, and Li Fei-Fei. 2015. ImageNet Large Scale Visual Recognition Challenge. International Journal of Computer Vision 115, 3 (2015), 211--252. Google ScholarDigital Library
- Joseph Robinson Shuyang Wang and Yun Fu. 2017. Kinship Verification on Families in the Wild with Marginalized Denoising Metric Learning. In 12th IEEE Conference on Automatic Face and Gesture Recognition.Google Scholar
- Xiaolong Wang, Guodong Guo, Michele Merler, Noel C. F. Codel- la, Rohith MV, John R. Smith, and Chandra Kambhamettu. 2017. Leveraging multiple cues for recognizing family photos. Image and Vision Computing 58 (2017), 61--75. Google ScholarDigital Library
- X. Wang, G. Guo, M. V. Rohith, and C. Kambhamettu. 2015. Leveraging geometry and appearance cues for recognizing fam- ily photos. In 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), Vol. 1. 1--8.Google Scholar
- Xifeng Yan and Jiawei Han. 2002. gSpan: graph-based substruc- ture pattern mining. In 2002 IEEE International Conference on Data Mining, 2002. Proceedings. 721--724. Google ScholarDigital Library
- Cha Zhang, John C. Platt, and Paul A. Viola. 2006. Multiple Instance Boosting for Object Detection. In Advances in Neural Information Processing Systems 18. 1417--1424. Google ScholarDigital Library
Index Terms
- Family Photo Recognition via Multiple Instance Learning
Recommendations
Photo to Family Tree: Deep Kinship Understanding for Nuclear Family Photos
ASMMC-MMAC'18: Proceedings of the Joint Workshop of the 4th Workshop on Affective Social Multimedia Computing and first Multi-Modal Affective Computing of Large-Scale Multimedia DataMulti-person kinship recognition is complicated and challenging as an extension of existing studies on recognizing kinship in pairwise face images independently, with little existing literature. In this paper, we extend kinship recognition from two ...
Leveraging multiple cues for recognizing family photos
AbstractSocial relation analysis via images is a new research area that has attracted much interest recently. As social media usage increases, a wide variety of information can be extracted from the growing number of consumer photos shared ...
Highlights- A new geometry feature is proposed to capture people's standing pattern at the scene level.
Face Photo-Sketch Synthesis and Recognition
In this paper, we propose a novel face photo-sketch synthesis and recognition method using a multiscale Markov Random Fields (MRF) model. Our system has three components: 1) given a face photo, synthesizing a sketch drawing; 2) given a face sketch ...
Comments