Beth Trushkowsky
- Bar-Yossef, Z., Gurevich, M. Efficient search engine measurements. ACM Trans. Web 5, 4 (Oct. 2011), 18:1--18:48. Google Scholar
Digital Library
- Broder, A., Fontura, M., Josifovski, V., Kumar, R., Motwani, R., Nabar, S., Panigrahy, R., Tomkins, A., Xu, Y. Estimating corpus size via queries. In Proceedings of CIKM (2006). Google ScholarDigital Library
- Bunge, J., Fitzpatrick, M. Estimating the number of species: A review. J. Am. Stat. Assoc. 88, 421 (1993), 364--373.Google Scholar
- Bunge, J., et al. Comparison of three estimators of the number of species. J. Appl. Stat. 22, 1 (1995), 45--59.Google ScholarCross Ref
- Burnham, K.P., Overton, W.S. Estimation of the size of a closed population when capture probabilities vary among animals. Biometrika 65, 3 (1978), 625--633.Google ScholarCross Ref
- Chao, A. Species estimation and applications. In Encyclopedia of Statistical Sciences, 2nd edn. N. Balakrishnan, C.B. Read, and B. Vidakovic, eds. Wiley, New York, 2005, 7907--7916.Google Scholar
- Chao, A., Lee, S. Estimating the number of classes via sample coverage. J. Am. Stat. Assoc. 87, 417 (1992), 210--217.Google ScholarCross Ref
- Charikar, M., et al. Towards estimation error guarantees for distinct values. In Proceedings of the PODS (2000). Google ScholarDigital Library
- Colwell, R.K., Coddington, J.A. Estimating terrestrial biodiversity through extrapolation. Philos. Trans. Biol. Sci. 345, 1311 (1994), 101--118.Google Scholar
- Doan, A., et al. Crowdsourcing applications and platforms: A data management perspective. PVLDB 4, 12 (2011), 1508--1509.Google Scholar
- Franklin, M.J., et al. CrowdDB: Answering queries with crowdsourcing. In Proceedings of the SIGMOD (2011). Google ScholarDigital Library
- Good, I.J. The population frequencies of species and the estimation of population parameters. Biometrika 40, 3/4 (1953), 237--264.Google ScholarCross Ref
- Gray, J., et al. Quickly generating billion-record synthetic databases. In Proceedings of the SIGMOD (1994). Google ScholarDigital Library
- Haas, P.J., et al. Sampling-based estimation of the number of distinct values of an attribute. In Proceedings of the VLDB (1995). Google ScholarDigital Library
- Heer, J., et al. Crowdsourcing graphical perception: Using mechanical turk to assess visualization design. In Proceedings of the CHI (2010). Google ScholarDigital Library
- Ipeirotis, P.G., Provost, F., Wang, J. Quality management on Amazon mechanical turk. In Proceedings of the HCOMP (2010). Google ScholarDigital Library
- Liu, K.-L., Yu, C., Meng, W. Discovering the representative of a search engine. In Proceedings of the CIKM (2002). Google ScholarDigital Library
- Lu, J., Li, D. Estimating deep web data source size by capture--recapture method. Inf. Retr. 13, 1 (Feb. 2010), 70--95. Google ScholarDigital Library
- Marcus, A., Wu, E., Madden, S., Miller, R. Crowdsourced databases: Query processing with people. In Proceedings of the CIDR (2011).Google Scholar
- Parameswaran, A., Polyzotis, N. Answering queries using humans, algorithms and databases. In Proceedings of the CIDR (2011).Google Scholar
- Shen, T., et al. Predicting the number of new species in further taxonomic sampling. Ecology 84, 3 (2003).Google ScholarCross Ref
- Trushkowsky, B., Kraska, T., Franklin, M.J., Sarkar, P. Crowdsourced enumeration queries. In Proceedings of the ICDE (2013). Google ScholarDigital Library
- Wang, J., et al. A sample-and-clean framework for fast and accurate query processing on dirty data. In Proceedings of the SIGMOD (2014), 469--480. Google ScholarDigital Library
Index Terms
- Answering enumeration queries with the crowd
Recommendations
Answering top-k queries using views
VLDB '06: Proceedings of the 32nd international conference on Very large data basesThe problem of obtaining efficient answers to top-k queries has attracted a lot of research attention. Several algorithms and numerous variants of the top-k retrieval problem have been introduced in recent years. The general form of this problem ...
Reviews
Amos O Olagunju
Human crowds are valuable assets for providing additional responses in real time to cognate query results derived solely from relational database management systems (RDBMSs). But how should query results from human crowds, designed to simultaneously augment database query results, be terminated to provide reliable responses__?__ Trushkowsky and colleagues offer statistical tools for users and developers of RDBMSs to use in scrutinizing the time and cost benefits of the accuracy and inclusiveness of query responses. In an effort to cover the inclusiveness of all behavioral groups, the size of a query result (cardinality) is useful for computing the percentage of each interest survey group. The authors compellingly introduce an effective power law distribution data model that helps to overcome the data sampling problems attributable to cultural and regional biases, and a variety of the knowledgeable uses of web search strategies. Clearly, the paper introduces and evaluates a metric for estimating the stable and convergent cardinality of "human intelligence tasks from Amazon's mechanical Turk (HIT-AMT)." The authors introduce algorithms that help to minimize the influence of individuals who might dominate and bias query responses. They present the concepts of the classes of distributions of coverage and variance of user responses to crowdsourced queries. The experimental results of the test statistics with several thousands of queries in HIT with the AMT RDBMS of United Nations and US data show some significant improvement over well-known studies. List walking is a situation when the total size of a query result is underpredicted due to multiple heavily skewed, or similar, survey responses. The authors propose and validate a heuristic binomial probabilistic algorithm to detect and overcome list walking. The algorithms successfully detected severe list walks in the United Nations database. Undoubtedly, the authors present algorithms for computing cost-benefit tradeoffs of generating precise accounts and estimates of query responses derived from the traditional and real-time crowdsourced RDBMSs. There is no doubt that users should be empowered to contribute and reason about query results in all relational database management searches and retrieval results. In spite of the new light shed on the applications of the well-known power-laws [1] and the binomial distribution in this paper, I encourage all statisticians and database specialists to read and address the outstanding remaining unanswered questions raised by the authors. Is there a clear distinction between operations such as SELECT, JOIN, and PROJECT versus relational operators on real query results__?__ What impacts do human behaviors have on the sampling process in crowdsourced queries__?__ Online Computing Reviews Service
Access critical reviews of Computing literature here
Become a reviewer for Computing Reviews.
Comments