Sujoy Chatterjee
Abstract
Leveraging the online crowd replacing limited experts has become a successful practice over the last decade for solving diverse real-life problems. Various complex problems are now being solved utilizing the power of crowd, an approach popularly termed as 'crowdsourcing'. Judgment analysis refers to a particular type of crowdsourcing task where we aggregate the opinions collected from the crowd for a purpose. We, being the rational agents, have a common interest towards knowing others' opinions before providing our own. This broadly categorizes the problem of judgment analysis into two types --- with independent and with dependent opinions. However, a new paradigm of crowd based judgment analysis has recently evolved, which can tackle the constrained opinions of crowd workers. In this article, we touch upon this novel problem of constrained crowd judgment analysis and discuss its possible dimensions of research.
- Chatterjee, S., Mukhopadhyay, A., and Bhattacharyya, M. 2017a. Judgment analysis based on crowdsourced opinions. In Proceedings of the 33rd IEEE International Conference on Data Engineering (ICDE). IEEE, San Diego, USA, 1439--1444.Google Scholar
- Chatterjee, S., Mukhopadhyay, A., and Bhattacharyya, M. 2017b. Smart city planning with constrained crowd judgment analysis. In Proceedings of the AAAI 2017 Spring Symposium on AI for Social Good (AISOC). AAAI Press, Palo Alto, USA, 16--22.Google Scholar
- CrowdMed. https://www.crowdmed.com.Google Scholar
- Glatz, J. 2010. Canning food, from napoleon to now. In Illinois Times.Google Scholar
- Webster, J. G. 2008. Nielsen ratings. In International Encyclopedia of Communication Online.Google Scholar
- Welinder, P., Branson, S., Belongie, S., and Perona., P. 2010. The multidimensional wisdom of crowds. In Proceedings of the Neural Information Processing System. Vancouver, Canada, 2424--2432. Google ScholarDigital Library
- Whitehill, J., Ruvolo, P., Wu, T., Bergsma, J., and Movellan., J. 2009. Whose vote should count more: Optimal integration of labels from labelers of unknown expertise. In Proceedings of the Neural Information Processing System. Vancouver, Canada, 2035--2043. Google ScholarDigital Library
Recommendations
A biclustering approach for crowd judgment analysis
CODS '15: Proceedings of the 2nd ACM IKDD Conference on Data SciencesCollection of multiple annotations from the crowd workers is useful for diverse applications. In this paper, the problem of obtaining the final judgment from such crowd-based annotations has been addressed in an unsupervised way using a biclustering-...
Crowd behavior analysis
Although the traits emerged in a mass gathering are often non-deliberative, the act of mass impulse may lead to irrevocable crowd disasters. The two-fold increase of carnage in crowd since the past two decades has spurred significant advances in the ...
Dependent judgment analysis
We introduce a novel crowd judgment analysis problem where the crowd opinions are dependent on each other.We introduce a novel method to compute the final aggregated judgments from multiple dependent opinions.In this method, the expertise of an ...
Comments