ABSTRACT
This paper studies conversational approaches to information retrieval, presenting a theory and model of information interaction in a chat setting. In particular, we consider the question of what properties would be desirable for a conversational information retrieval system so that the system can allow users to answer a variety of information needs in a natural and efficient manner. We study past work on human conversations, and propose a small set of properties that taken together could measure the extent to which a system is conversational. Following this, we present a theoretical model of a conversational system that implements the properties. We describe how this system could be implemented, making the action space of an conversational search agent explicit. Our analysis of this model shows that while theoretical, the model could be practically implemented to satisfy the desirable properties presented. In doing so, we show that the properties are also feasible.
- J. Allen, C. I. Guinn, and E. Horvtz. Mixed-initiative interaction. IEEE Intelligent Systems and their Applications, 14(5):14--23, 1999.Google ScholarDigital Library
- M. J. Bates. The design of browsing and berrypicking techniques for the online search interface. Online review, 13(5):407--424, 1989.Google ScholarCross Ref
- N. J. Belkin, C. Cool, A. Stein, and U. Thiel. Cases, scripts, and information seeking strategies: on the design of interactive information retrieval systems. Expert Systems with Applications, 9:379--395, 1995.Google ScholarCross Ref
- P. N. Bennett, R. W. White, W. Chu, S. T. Dumais, P. Bailey, F. Borisyuk, and X. Cui. Modeling the impact of short- and long-term behavior on search personalization. In Proceedings of the ACM SIGIR International Conference on Research and Development in Information Retrieval (SIGIR), 2012. Google ScholarDigital Library
- D. Carmel, G. Halawi, L. Lewin-Eytan, Y. Maarek, and A. Raviv. Rank by time or by relevance?: Revisiting email search. In Proceedings of ACM Conference on Information and Knowledge Management (CIKM), pages 283--292, 2015. Google ScholarDigital Library
- J. Cassell. More than just another pretty face: Embodied conversational interface agents. Communications of the ACM, 4(43):70--78, 2000. Google ScholarDigital Library
- Y. Chen and G. J. F. Jones. Are episodic context features helpful for refinding tasks? lessons learnt from a case study with lifelogs. In Proceedings of the Information Interaction in Context Symposium (IIiX), 2014. Google ScholarDigital Library
- Y.-N. Chen, D. Hakkani-Tur, and X. He. Zero-shot learning of intent embeddings for expansion by convolutional deep structured semantic models. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP), March 2016.Google ScholarDigital Library
- K. Christakopoulou, F. Radlinski, and K. Hofmann. Towards conversational recommender systems. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), 2016. Google ScholarDigital Library
- J. Chu-Carroll and M. K. Brown. An evidential model for tracking initiative in collaborative dialogue interactions. In S. Haller, A. Kobsa, and S. McRoy, editors, Computational Models of Mixed-Initiative Interaction, pages 49--87. Springer, 1999.Google Scholar
- K. Collins-Thompson, C. Macdonald, P. Bennett, and E. M. Voorhees. TREC 2014 web track overview. NIST Special Publication 500--308: The Twenty-Third Text REtrieval Conference Proceedings (TREC), 2014.Google Scholar
- E. Cutrell, S. T. Dumais, and J. Teevan. Searching to eliminate personal information management. Communications of the ACM, 49(1):58--64, 2006. Google ScholarDigital Library
- R. Dhar. Consumer preference for a no-choice option. Journal of Consumer Research, 24(2):215--231, 1997.Google ScholarCross Ref
- M. Dredze, B. N. Schilit, and P. Norvig. Suggesting email view filters for triage and search. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), 2009. Google ScholarDigital Library
- M. A. Hearst. 'natural' search user interfaces. Communications of the ACM, 54(11):60--67, 2011. Google ScholarDigital Library
- M. Henderson, B. Thomson, and S. J. Young. Deep neural network approach for the dialog state tracking challenge. In Proceedings of the Annual SIGdial Meeting on Discourse and Dialogue (SIGDIAL), 2013.Google Scholar
- J. Jiang, A. H. Awadallah, R. Jones, U. Ozertem, I. Zitouni, R. G. Kulkarni, and O. Z. Khan. Automatic online evaluation of intelligent assistants. In Proceedings of the International World Wide Web Conference (WWW), 2015. Google ScholarDigital Library
- D. G. Johnson and T. M. Powers. Computers as surrogate agents. In J. van den Hoven and J. Weckert, editors, Information Technology and Moral Philosophy, chapter 13. Cambridge University Press, 2008.Google Scholar
- M. P. Kato and K. Tanaka. To suggest, or not to suggest for queries with diverse intents: Optimizing search result presentation. In Proceedings of the ACM International Conference on Web Search and Data Mining (WSDM), pages 133--142. ACM, 2016. Google ScholarDigital Library
- J. Kiseleva, K. Williams, J. Jiang, A. H. Awadallah, A. C. Crook, I. Zitouni, and T. Anastasakos. Understanding user satisfaction with intelligent assistants. In Proceedings of the ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR), 2016. Google ScholarDigital Library
- G. Linden, S. Hanks, and N. Lesh. Interactive assessment of user preference models: The automated travel assistant. In User Modeling, pages 67--78. Springer, 1997.Google ScholarCross Ref
- N. Matthijs and F. Radlinski. Personalizing web search using long term browsing history. In Proceedings of the ACM International Conference on Web Search and Data Mining (WSDM), pages 25--34, 2011. Google ScholarDigital Library
- K. McCarthy, Y. Salem, and B. Smyth. Experience-based critiquing: Reusing critiquing experiences to improve conversational recommendation. In Proceedings of the International Conference on Case-Based Reasoning, pages 480--494. Springer, 2010. Google ScholarDigital Library
- R. Nordlie. ''user revealment'' -- a comparison of initial queries and ensuing question development in online searching and in human reference interactions. In Proceedings of the ACM SIGIR International Conference on Research and Development in Information Retrieval (SIGIR), pages 11--18, 1999. Google ScholarDigital Library
- D. G. Novick and S. Sutton. What is mixed-initiative interaction. In Procedings of the AAAI Spring Symposium on Computational Models for Mixed Initiative Interaction, pages 114--116, 1997.Google Scholar
- T. Paek and E. Horvitz. Conversation as action under uncertainty. In Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI), pages 455--464, 2000. Google ScholarDigital Library
- A. Raux and M. Eskenazi. Optimizing the turn-taking behavior of task-oriented spoken dialog systems. ACM Transactions on Speech Language Processing, 9(1):1:1--1:23, May 2012. Google ScholarDigital Library
- J. Reilly, K. McCarthy, L. McGinty, and B. Smyth. Incremental critiquing. In Proceedings of the SGAI International Conference on Innovative Techniques and Applications of Artificial Intelligence, 2004.Google Scholar
- J. J. Rocchio. Relevance feedback in information retrieval. In G. Salton, editor, The SMART Retrieval System - Experiments in Automatic Document Processing. Prentice Hall, Englewood, Cliffs, New Jersey, 1971.Google Scholar
- S. Senecal and J. Nantel. The influence of online product recommendations on consumers' online choices. Journal of Retailing, 80:159--169, 2004.Google ScholarCross Ref
- A. Sordoni, M. Galley, M. Auli, C. Brockett, Y. Ji, M. Mitchell, J.-Y. Nie, J. Gao, and B. Dolan. A neural network approach to context-sensitive generation of conversational responses. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics -- Human Language Technologies (NAACL-HLT), June 2015.Google ScholarCross Ref
- P.-H. Su, M. Gažić, N. Mrkžić, L. Rojas-Barahona, S. Ultes, D. Vandyke, T.-H. Wen, and S. Young. On-line active reward learning for policy optimisation in spoken dialogue systems. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), 2016.Google ScholarCross Ref
- S. Sukhbaatar, a. szlam, J. Weston, and R. Fergus. End-to-end memory networks. In Proceedings of the International Conference on Advances in Neural Information Processing Systems (NIPS), pages 2440--2448, 2015. Google ScholarDigital Library
- P. ten Have. Doing Conversation Analysis: A Practical Guide. SAGE Publications Ltd, 2007.Google Scholar
- N. Tintarev and J. Masthoff. Effective explanations of recommendations: user-centered design. In Proceedings of the ACM conference on Recommender Systems (RecSys), pages 153--156, 2007. Google ScholarDigital Library
- D. Traum, D. DeValut, J. Lee, Z. Wang, and S. Marsella. Incremental dialogue understanding and feedback for multiparty, multimodal conversation. In Proceedings of Intelligent Virtual Agents (IVA), pages 275--288, 2012. Google ScholarDigital Library
- M. Walker and S. Whittaker. Mixed initiative in dialogue: An investigation into discourse segmentation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), pages 70--78, 1990. Google ScholarDigital Library
- Z. Wang, J. Lee, and S. Marsella. Towards more comprehensive listening behavior: Beyond the bobble head. In Proceedings of Intelligent Virtual Agents (IVA), pages 216--227, 2011. Google ScholarDigital Library
- J. Weizenbaum. ELIZA -- a computer program for the study of natural language communication between man and machine. Communications of the ACM, 9:36--45, January 1966. Google ScholarDigital Library
- R. W. White and D. Morris. Investigating the querying and browsing behavior of advanced search engine users. In Proceedings of the ACM SIGIR International Conference on Research and Development in Information Retrieval (SIGIR), 2007. Google ScholarDigital Library
- J. Williams, A. Raux, D. Ramachadran, and A. Black. The dialog state tracking challenge. In Proceedings of the Annual SIGdial Meeting on Discourse and Dialogue (SIGDIAL), 2013.Google Scholar
- K. Yao and G. Zweig. Attention with intention for neural network conversation model. In NIPS Workshop on Machine Learning for Spoken Language Understanding and Interaction, 2015.Google Scholar
- K.-P. Yee, K. Swearingen, K. Li, and M. Hearst. Faceted metadata for image search and browsing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), pages 401--408. ACM, 2003. Google ScholarDigital Library
- S. Young, M. Gažić, B. Thomson, and J. D. Williams. Pomdp-based statistical spoken dialog systems: A review. Proceedings of the IEEE, 101(5):1160--1179, 2013.Google ScholarCross Ref
- Y. Zhang and C. Zhai. A sequential decision formulation of the interface card model for interactive ir. In Proceedings of the ACM SIGIR International Conference on Research and Development in Information Retrieval (SIGIR), pages 85--94. ACM, 2016. Google ScholarDigital Library
Index Terms
A Theoretical Framework for Conversational Search
Recommendations
Towards Conversational Search and Recommendation: System Ask, User Respond
CIKM '18: Proceedings of the 27th ACM International Conference on Information and Knowledge ManagementConversational search and recommendation based on user-system dialogs exhibit major differences from conventional search and recommendation tasks in that 1) the user and system can interact for multiple semantically coherent rounds on a task through ...
Informing the Design of Spoken Conversational Search: Perspective Paper
CHIIR '18: Proceedings of the 2018 Conference on Human Information Interaction & RetrievalWe conducted a laboratory-based observational study where pairs of people performed search tasks communicating verbally. Examination of the discourse allowed commonly used interactions to be identified for Spoken Conversational Search (SCS). We compared ...
Wizard of Oz Interface to Study System Initiative for Conversational Search
CHIIR '20: Proceedings of the 2020 Conference on Human Information Interaction and RetrievalWe describe a Wizard of Oz (WoZ) system, a WebApp, which we use to study how a conversational search system should take the initiative when engaging with users during collaborative search. This system integrates directly into Slack, a chat-messaging ...
Comments