Shuguang Han
Zhen Yue
Skip Abstract Section
Abstract
Mobile devices enable people to look for information at the moment when their information needs are triggered. While experiencing complex information needs that require multiple search sessions, users may utilize desktop computers to fulfill information needs started on mobile devices. Under the context of mobile-to-desktop web search, this article analyzes users’ behavioral patterns and compares them to the patterns in desktop-to-desktop web search. Then, we examine several approaches of using Mobile Touch Interactions (MTIs) to infer relevant content so that such content can be used for supporting subsequent search queries on desktop computers. The experimental data used in this article was collected through a user study involving 24 participants and six properly designed cross-device web search tasks. Our experimental results show that (1) users’ mobile-to-desktop search behaviors do significantly differ from desktop-to-desktop search behaviors in terms of information exploration, sense-making and repeated behaviors. (2) MTIs can be employed to predict the relevance of click-through documents, but applying document-level relevant content based on the predicted relevance does not improve search performance. (3) MTIs can also be used to identify the relevant text chunks at a fine-grained subdocument level. Such relevant information can achieve better search performance than the document-level relevant content. In addition, such subdocument relevant information can be combined with document-level relevance to further improve the search performance. However, the effectiveness of these methods relies on the sufficiency of click-through documents. (4) MTIs can also be obtained from the Search Engine Results Pages (SERPs). The subdocument feedbacks inferred from this set of MTIs even outperform the MTI-based subdocument feedback from the click-through documents.
- M. Ageev, Q. Guo, D. Lagun, and E. Agichtein. 2011. Find it if you can: A game for modeling different types of web search success using interaction data. In Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’11). ACM, New York, NY, 345--354. Google Scholar
Digital Library
- E. Agichtein, R. W. White, S. T. Dumais, and P. N. Bennet. 2012. Search, interrupted: Understanding and predicting search task continuation. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’12). ACM, New York, NY, 315--324. Google ScholarDigital Library
- R. Baeza-Yates and B. Ribeiro-Neto. 1999. Modern Information Retrieval. ACM Press, New York, NY. Google ScholarDigital Library
- P. Bennett, R. W. White, W. Chu, S. Dumais, P. Bailey, F. Borisyuk, and X. Cui. 2012. Modeling the impact of short- and long-term behavior on search personalization. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’12). ACM, New York, NY, 185--194. Google ScholarDigital Library
- R. Biedert, A. Dengel, G. Buscher, and A. Vartan. 2012. Reading and estimating gaze on smart phones. In the Proceedings of the Symposium on Eye Tracking Research and Applications. 385--388. Google ScholarDigital Library
- P. Borlund. 2000. Experimental components for the evaluation of interactive information retrieval systems. Journal of Documentation 56, 1 (2000), 71--90.Google ScholarCross Ref
- G. Buscher, A. Dengel, and L. V. Elst. 2008. Query expansion using gaze-based feedback on the subdocument level. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’08). ACM, New York, NY, 387--394. Google ScholarDigital Library
- G. Buscher, V. L. Elst, and A. Dengel. 2009. Segment-level display time as implicit feedback: A comparison to eye tracking. In Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’09). ACM, New York, NY, 67--74. Google ScholarDigital Library
- D. Dearman and J. Pierce. 2008. It's on my other computer!: Computing with multiple devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’08). 767--776. Google ScholarDigital Library
- A. Dieberger. 1997. Supporting social navigation on the World Wide Web. International Journal of Human-Computer Studies, 46, 6 (1997), 805--825. Google ScholarDigital Library
- C. Eickhoff, J. Teevan, R. White, and S. Dumais. 2014. Lessons from the journey: A query log analysis of within-session learning. In Proceedings of the ACM Conference on Web Search and Data Mining (WSDM’14). ACM, New York, NY, 223--232. Google ScholarDigital Library
- B. M. Evans and E.H. Chi. 2010. An elaborated model of social search. Information Processing and Management 46, 6 (Nov. 2010), 656--678. Google ScholarDigital Library
- D. Guan, S. Zhang, and H. Yang. 2013. Utilizing query change for session search. In Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, New York, NY, 453--462. Google ScholarDigital Library
- Q. Guo and E. Agichtein. 2012. Beyond dwell time: Estimating document relevance from cursor movements and other post-click searcher behavior. In Proceedings of the 21st International Conference on World Wide Web (WWW’12). ACM, New York, NY, 569--578. Google ScholarDigital Library
- Q. Guo, H. Jin, D. Lagun, S. Yuan, and E. Agichtein. 2013. Mining touch interaction data on mobile devices to predict web search result relevance. In Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’13). ACM, New York, NY, 153--162. Google ScholarDigital Library
- Q. Guo, S. Yuan, and E. Agichtein. 2011. Detecting success in mobile search from interaction. In Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’11). ACM, New York, NY, 1229--1230. Google ScholarDigital Library
- S. Han, I. H. Hsiao, and D. Parra. 2014. A study of mobile information exploration with multi-touch interactions. In Proceedings of the Social Computing, Behavioral-Cultural Modeling and Prediction (SBP’14). Springer International Publishing, 269--276.Google Scholar
- J. Huang, R. W. White, and S. Dumais. 2011. No clicks, no problem: Using cursor movements to understand and improve search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’11). ACM, New York, NY, 1225--1234. Google ScholarDigital Library
- J. Huang, R. W. White, G. Buscher, and K. Wang. 2012. Improving searcher models using mouse cursor activity. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’12). ACM, New York, NY, 195--204. Google ScholarDigital Library
- S. T. Iqbal and B. P. Bailey. 2005. Investigating the effectiveness of mental workload as a predictor of opportune moments for interruption. In CHI’05 Extended Abstracts on Human Factors in Computing Systems (CHI EA’05), 1489--1492. Google ScholarDigital Library
- J. K. Jarvelin, S. L. Price, L. M. L. Delcambre, and M. L. Nielsen. 2008. Discounted cumulated gain based evaluation of multiple-query IR sessions. In Proceedings of the IR Research, 30th European Conference on Advances in Information Retrieval. Lecture Notes in Computer Science, Vol. 4956. Springer-Verlag, 4--15. Google ScholarDigital Library
- J. Jiang, S. Han, J. Wu, and D. He. 2011. PITT at TREC 2011 session track. In Proceedings of the 20th Text REtrieval Conference (TREC’11).Google Scholar
- J. Jiang, D. He, and S. Han. 2012. On duplicate results in a search session. In Proceedings of the 21st Text Retrieval Conference (TREC’12).Google Scholar
- T. Joachims, L. Granka, B. Pan, H. Hembrooke, and G. Gay. 2005. Accurately interpreting clickthrough data as implicit feedback. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’05). ACM, New York, NY, 154--161. Google ScholarDigital Library
- R. Kajan, I. Szentandrási, A. Herout, and M. Zachariáš. 2013. On-screen marker fields for reliable screen-to-screen task migration. In Human Factors in Computing and Informatics. Lecture Notes in Computer Science, Vol. 7946. 692--710.Google ScholarCross Ref
- M. Kamvar and S. Baluja. 2007. Deciphering trends in mobile search. Computer, 40, 8 (2007), 58--62. Google ScholarDigital Library
- S. K. Kane, A. K. Karlson, B. R. Meyers, P. Johns, A. Jacobs, and G. Smith. 2009. Exploring cross-device web use on PCs and mobile devices. In Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction. Springer, 722--735. Google ScholarDigital Library
- E. Kanoulas, B. Carterette, M. Hall, P. Clough, and M. Sanderson. 2011. Session track 2011 overview. In Proceedings of the 20th Text Retrieval Conference (TREC’11).Google Scholar
- A. K. Karlson, S. T. Iqbal, B. Meyers, G. Ramos, K. Lee, and J. C. Tang. 2010. Mobile taskflow in context: A screenshot study of smartphone usage. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’10). ACM, New York, NY, 2009--2018. Google ScholarDigital Library
- D. Kelly. 2009. Methods for evaluating interactive information retrieval systems with users. Found. Trends Inf. Retr. 3, 1--2 (Jan. 2009), 1--224. Google ScholarDigital Library
- C. Kohlschütter, P. Fankhauser, and W. Nejdl. 2010. Boilerplate detection using shallow text features. In the Proceedings of the 3rd ACM International Conference on Web Search and Data Mining (WSDM’10), 441--450. Google ScholarDigital Library
- W. Kong, E. Aktolga, and J. Allan. 2013. Improving passage ranking with user behavior information. In Proceedings of the 22nd ACM International Conference on Information and Knowledge Management (CIKM’13). ACM, New York, NY, 1999--2008. Google ScholarDigital Library
- A. Kotov, P. N. Bennett, R. W. White, S. T. Dumais, and J. Teevan. 2011. Modeling and analysis of cross-session search tasks. In Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’11). ACM, New York, NY, 5--14. Google ScholarDigital Library
- X. Liu and W. B. Croft. 2002. Passage retrieval based on language models. In Proceedings of the 11th International Conference on Information and Knowledge Management (CIKM’02). ACM, New York, NY, 375--382. Google ScholarDigital Library
- Y. Lv and C. Zhai. 2009. Positional language models for information retrieval. In Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’09). ACM, New York, NY, 299--306. Google ScholarDigital Library
- Y. Lv and C. Zhai. 2010. Positional relevance model for pseudo-relevance feedback. In Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’10). ACM, New York, NY, 579--586. Google ScholarDigital Library
- G. Marchionini. 2006. Exploratory search: From finding to understanding. Commun. ACM, 49, 4 (2006), 41--46. Google ScholarDigital Library
- A. Newell and H. A. Simon. 1972. Human Problem Solving. Prentice-Hall, Englewood Cliffs, NJ, 1972. Google ScholarDigital Library
- A. Oulasvirta and L. Sumari. 2007. Mobile kits and laptop trays: Managing multiple devices in mobile information work. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’07), 1127--1136. Google ScholarDigital Library
- K. Raman, P. N. Bennett, and K. Collins-Thompson. 2013. Toward whole-session relevance: Exploring intrinsic diversity in web search. In Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’13). ACM, New York, NY, 463--472 Google ScholarDigital Library
- G. Salton and C. Buckley. 1990. Improving retrieval performance by relevance feedback. Journal of the American Society of Information Science, 41, 4 (1990), 288--297.Google ScholarCross Ref
- X. Shen, B. Tan, and C. Zhai. 2005. Context-sensitive information retrieval using implicit feedback. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’05). ACM, New York, NY, 43--50. Google ScholarDigital Library
- M. Shokouhi, R. W. White, P. Bennett, and F. Radlinski. 2013. Fighting search engine amnesia: Reranking repeated results. In Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’13). ACM, New York, NY, 273--282. Google ScholarDigital Library
- T. Sohn, F. C. Y. Li, A. Battestini, V. Setlur, K. Mori, and H. Horii. 2011. Myngle: Unifying and filtering web content for unplanned access between multiple personal devices. In Proceedings of the 13th International Conference on Ubiquitous Computing (UbiComp’11). ACM, New York, NY, 257--266. Google ScholarDigital Library
- Y. Song, H. Ma, H. Wang, and K. Wang. 2013. Exploring and exploiting user search behavior on mobile and tablet devices to improve search relevance. In Proceedings of the 22nd International Conference on World Wide Web (WWW’13). 1201--1212. Google ScholarDigital Library
- D. Sontag, K. Collins-Thompson, P. Bennett, N. R. W. White, S. T. Dumais, and B. Billerbeck. 2012. Probabilistic models for personalizing web search. In Proceedings of the 5th ACM International Conference on Web Search and Data Mining (WSDM’12). ACM, New York, NY, 433--442. Google ScholarDigital Library
- A. Spink. 2002. A user-centered approach to evaluating human interaction with web search engines: An exploratory study. Information Processing and Management 38, 3 (2002), 401--426. Google ScholarDigital Library
- B. Tan, X. Shen, and C. Zhai. 2006. Mining long-term search history to improve search accuracy. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’06). ACM, New York, NY, 718--723. Google ScholarDigital Library
- J. Teevan, C. Alvarado, M. S. Ackerman, and D. R. Karger. 2004. The perfect search engine is not enough: A study of orienteering behavior in directed search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 415--422. Google ScholarDigital Library
- J. Teevan, S. T. Dumais, and D. J. Liebling. 2008. To personalize or not to personalize: Modeling queries with variation in user intent. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’08). ACM, New York, NY, 163--170. Google ScholarDigital Library
- J. Teevan, E. Adar, R. Jones, and M. A. S. Potts. 2007. Information re-retrieval: Repeat queries in Yahoo's logs. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’07). ACM, New York, NY, 151--158. Google ScholarDigital Library
- J. Teevan, D. Liebling, and G. R. Geetha. 2011. Understanding and predicting personal navigation. In Proceedings of the 4th ACM International Conference on Web Search and Data Mining (WSDM’11). ACM, New York, NY, 85--94. Google ScholarDigital Library
- J. L. Teugels, and B. Sundt. (Eds.). 2006. Encyclopedia of Actuarial Science. John Wiley & Sons, Ltd.Google Scholar
- H. Wang, Y. Song, M. Chang, X. He, R. White, and W. Chu. 2013a. Learning to extract cross-session search tasks. In Proceedings of the 22nd International Conference on World Wide Web (WWW’13). Google ScholarDigital Library
- Y. Wang, X. Huang, and R. W. White. 2013b. Characterizing and supporting cross-device search tasks. In Proceedings of the6th ACM International Conference on Web Search and Data Mining. ACM, New York, NY, 707--716. Google ScholarDigital Library
- R. W. White, P. N. Bennett, and S. T. Dumais. 2010. Predicting short-term interests using activity-based search context. In Proceedings of the 19th ACM International Conference on Information and Knowledge Management (CIKM’10). ACM, New York, NY, 1009--1018. Google ScholarDigital Library
- R. W. White, W. Chu, A. Hassan, X. He, Y. Song, and H. Wang. 2013. Enhancing personalized search by mining and modeling task behavior. In Proceedings of the 22nd International Conference on World Wide Web (WWW’13). 1411--1420. Google ScholarDigital Library
- J. Yi, F. Maghoul, and J. Pedersen. 2008. Deciphering mobile search patterns: A study of Yahoo! mobile search queries. In Proceedings of the 17th International Conference on World Wide Web (WWW’08). ACM, New York, NY, 257--266. Google ScholarDigital Library
- S. Yu, D. Cai, J.-R. Wen, and W.-Y. Ma. 2003. Improving pseudo-relevance feedback in web information retrieval using web page segmentation. In Proceedings of the 12th International Conference on World Wide Web (WWW’03). ACM, New York, NY, 11--18. Google ScholarDigital Library
- Z. Yue, S. Han, and D. He. 2014. Modeling search processes using hidden states in collaborative exploratory web search. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW’14). ACM, New York, NY, 820--830. Google ScholarDigital Library
- C. Zhai and J. Lafferty. 2001. Model-based feedback in the language modeling approach to information retrieval. In Proceedings of the 10th International Conference on Information and Knowledge Management (CIKM’01), 403--410. Google ScholarDigital Library
- C. Zhai and J. Lafferty. 2004. A study of smoothing methods for language models applied to information retrieval. ACM Trans. Inf. Syst. 22, 2 (April 2004), 179--214. Google ScholarDigital Library
Index Terms
- Understanding and Supporting Cross-Device Web Search for Exploratory Tasks with Mobile Touch Interactions
Recommendations
Re-ranking search results using query logs
CIKM '06: Proceedings of the 15th ACM international conference on Information and knowledge managementThis work addresses two common problems in search, frequently occurring with underspecified user queries: the top-ranked results for such queries may not contain documents relevant to the user's search intent, and fresh and relevant pages may not get ...
Improving Web search using image snippets
The Web has become the largest information repository in the world; thus, effectively and efficiently searching the Web becomes a key challenge. Interactive Web search divides the search process into several rounds, and for each round the search engine ...
Using web-graph distance for relevance feedback in web search
SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrievalWe study the effect of user supplied relevance feedback in improving web search results. Rather than using query refinement or document similarity measures to rerank results, we show that the web-graph distance between two documents is a robust measure ...
Comments