User profiling for answer quality assessment in Q&A communities

ABSTRACT

Collaborative Web applications, such as forums and question answering websites, help users to get answers to a wide array of questions. Given the large amount of information available, it is important to devise automatic methods that surface high quality answers. Our objective here is to determine if there are any particular aspects of a user's profile or activity in the community that can be exploited to spot high quality contributions. We first perform an in-depth analysis of the information provided by the users in their profiles in order to discriminate features that are correlated to expertise. Then, we propose an answer ranking scenario in which we assess the predictive capabilities of profile and activity related features. In our experiments, we use a large scale corpus from Stackoverflow, a very active Q&A community focused on technical topics and find that answer rankings obtained using a user model outperform a ranking based on the chronological order of answers.

References

1. J. Bian, Y. Liu, D. Zhou, E. Agichtein, and H. Zha. Learning to recognize reliable users and content in social media with coupled mutual reinforcement. In Proceedings of the 18th international conference on World wide web, pages 51--60. ACM, 2009.
2. M. Bouguessa, B. Dumoulin, and S. Wang. Identifying authoritative actors in question-answering forums: the case of yahoo! answers. In Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 2008.
3. T. Deselaers, D. Keysers, and H. Ney. Features for image retrieval: an experimental comparison. Information Retrieval, 11(2):77--107, 2008.
4. B. V. Hanrahan, G. Convertino, and L. Nelson. Modeling problem difficulty and expertise in stackoverflow. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work Companion, pages 91--94. ACM, 2012.
5. T. Joachims. Training linear svms in linear time. In Proc. of ACM KDD'06, pages 217--226. ACM, 2006.
6. D.-R. Liu, Y.-H. Chen, W.-C. Kao, and H.-W. Wang. Integrating expert profile, reputation and link analysis for expert finding in question-answering websites. Information Processing & Management, 2012.
7. Q. Liu and E. Agichtein. Modeling answerer behavior in collaborative question answering systems. In Advances in Information Retrieval, pages 67--79. Springer, 2011.
8. L. Mamykina, B. Manoim, M. Mittal, G. Hripcsak, and B. Hartmann. Design lessons from the fastest q&a site in the west. In Proceedings of the SIGCHI conference on Human factors in computing systems, pages 2857--2866. ACM, 2011.
9. A. Pal, S. Chang, and J. A. Konstan. Evolution of experts in question answering communities. In ICWSM, 2012.
10. A. Pal and S. Counts. What's in a name? how name value biases judgment of microblog authors. In Proc. of ICWSM'11, 2011.
11. A. Pal, R. Farzan, J. A. Konstan, and R. E. Kraut. Early detection of potential experts in question answering communities. In User Modeling, Adaption and Personalization, pages 231--242. Springer, 2011.

Index Terms

• Information systems