A computational theory of grounding in natural language conversation
- Author:
- David Rood Traum
Skip Abstract Section
Abstract
The process of adding to the common ground between conversational participants (called grounding) has previously been either oversimplified or studied in an off-line manner. This dissertation presents a computational theory, in which a protocol is presented which can be used to determine, for any given state of the conversation, whether material has been grounded or what it would take to ground the material. This protocol is related to the mental states of participating agents, showing the motivations for performing particular grounding acts and what their effects will be.
We extend speech act theory to account for levels of action both above and below the sentence level, including the level of grounding acts described above. Traditional illocutionary acts are now seen to be multi-agent acts which must be grounded to have their usual effects.
A conversational agent model is provided, showing how grounding fits in naturally with the other functions that an agent must perform in engaging in conversation. These ideas are implemented within the TRAINS conversation system.
Also presented is a situation-theoretic model of plan execution relations, giving definitions of what it means for an action to begin, continue, complete, or repair the execution of a plan. This framework is then used to provide precise definitions of the grounding acts in terms of agents executing a general communication plan in which one agent must present the content and another acknowledge it.
Cited By
Gratch J and Lucas G Rapport Between Humans and Socially Interactive Agents The Handbook on Socially Interactive Agents, (433-462)- Williams T, Yazdani F, Suresh P, Scheutz M and Beetz M (2019). Dempster-Shafer theoretic resolution of referential ambiguity, Autonomous Robots, 43:2, (389-414), Online publication date: 1-Feb-2019.
- Umata I, Ijuin K, Kato T and Yamamoto S Floor Apportionment and Mutual Gazes in Native and Second-Language Conversation Proceedings of the 20th ACM International Conference on Multimodal Interaction, (334-341)
- Williams T Toward Ethical Natural Language Generation for Human-Robot Interaction Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, (281-282)
- Ijuin K, Taguchi K, Umata I and Yamamoto S Eye Gaze Analyses in L1 and L2 Conversations Proceedings of the 2014 workshop on Understanding and Modeling Multiparty, Multimodal Interactions, (33-37)
- Pejsa T, Bohus D, Cohen M, Saw C, Mahoney J and Horvitz E Natural Communication about Uncertainties in Situated Interaction Proceedings of the 16th International Conference on Multimodal Interaction, (283-290)
- Chai J, She L, Fang R, Ottarson S, Littley C, Liu C and Hanson K Collaborative effort towards common ground in situated human-robot dialogue Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction, (33-40)
- Neiberg D, Salvi G and Gustafson J (2013). Semi-supervised methods for exploring the acoustics of simple productive feedback, Speech Communication, 55:3, (451-469), Online publication date: 1-Mar-2013.
- Mayfield E, Adamson D and Rosé C Hierarchical conversation structure prediction in multi-party chat Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue, (60-69)
- Koller A, Staudte M, Garoufi K and Crocker M Enhancing referential success by tracking hearer gaze Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue, (30-39)
- Cohen D and Lane I A simulation-based framework for spoken language understanding and action selection in situated interaction NAACL-HLT Workshop on Future Directions and Needs in the Spoken Dialog Community: Tools and Data, (33-36)
- van Drunen A Dialogue management and automation in interaction with unmanned systems Proceedings of the 2nd International Conference on Application and Theory of Automation in Command and Control Systems, (166-169)
- Benotti L and Blackburn P Classical planning and causal implicatures Proceedings of the 7th international and interdisciplinary conference on Modeling and using context, (26-39)
- Benotti L and Bertoa N Content determination through planning for flexible game tutorials Proceedings of the 10th Mexican international conference on Advances in Artificial Intelligence - Volume Part I, (345-356)
- Bunt H Interpretation and generation of dialogue with multidimensional context models Proceedings of the Third COST 2102 international training school conference on Toward autonomous, adaptive, and context-aware multimodal interfaces: theoretical and practical issues, (214-242)
- Cavicchio F The modulation of cooperation and emotion in dialogue Proceedings of the ACL-IJCNLP 2009 Student Research Workshop, (81-87)
- Li S, Wrede B and Sagerer G A computational model of multi-modal grounding for human robot interaction Proceedings of the 7th SIGdial Workshop on Discourse and Dialogue, (153-160)
- Ludwig B Tracing actions helps in understanding interactions Proceedings of the 7th SIGdial Workshop on Discourse and Dialogue, (60-67)
- Al-Raheb Y DRT representation of degrees of belief Proceedings of the 7th SIGdial Workshop on Discourse and Dialogue, (46-53)
- Varges S, Weng F and Pon-Barry H Interactive question answering and constraint relaxation in spoken dialogue systems Proceedings of the 7th SIGdial Workshop on Discourse and Dialogue, (28-35)
- Brenner M and Nebel B (2009). Continual planning and acting in dynamic multiagent environments, Autonomous Agents and Multi-Agent Systems, 19:3, (297-331), Online publication date: 1-Dec-2009.
- Wolters M, Georgila K, Moore J and MacPherson S (2009). Being Old Doesn’t Mean Acting Old, ACM Transactions on Accessible Computing, 2:1, (1-39), Online publication date: 1-May-2009.
- Wolters M, Georgila K, Moore J, Logie R, MacPherson S and Watson M (2009). Reducing working memory load in spoken dialogue systems, Interacting with Computers, 21:4, (276-287), Online publication date: 1-Aug-2009.
- Knott A and Vlugter P (2008). Multi-agent human--machine dialogue, Artificial Intelligence, 172:2-3, (69-102), Online publication date: 1-Feb-2008.
- Roque A and Traum D Degrees of grounding based on evidence of understanding Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue, (54-63)
- Lascarides A and Asher N Agreement and disputes in dialogue Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue, (29-36)
- Bunt H and Morante R The weakest link Proceedings of the 10th international conference on Text, speech and dialogue, (591-598)
- Loisel A, Chaignaud N and Kotowicz J Designing a Human-Computer Dialog System for Medical Information Search Proceedings of the 2007 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Workshops, (350-353)
- Krämer N Theory of mind as a theoretical prerequisite to model communication with virtual humans Proceedings of the Embodied communication in humans and machines, 2nd ZiF research group international conference on Modeling communication with robots and virtual humans, (222-240)
- Iwahashi N Robots that learn language Proceedings of the Third international conference on Emergence and Evolution of Linguistic Communication: symbol Grounding and Beyond, (143-167)
- Gaudou B, Herzig A, Longin D and Nickles M A New Semantics for the FIPA Agent Communication Language based on Social Attitudes Proceedings of the 2006 conference on ECAI 2006: 17th European Conference on Artificial Intelligence August 29 -- September 1, 2006, Riva del Garda, Italy, (245-249)
- Mao W and Gratch J Evaluating a computational model of social causality and responsibility Proceedings of the fifth international joint conference on Autonomous agents and multiagent systems, (985-992)
- Pasquier P and Chaib-Draa B (2005). Agent communication pragmatics, Cognitive Systems Research, 6:4, (364-395), Online publication date: 1-Dec-2005.
- Schlangen D Towards finding and fixing fragments Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, (247-254)
- Li S, Haasch A, Wrede B, Fritsch J and Sagerer G Human-style interaction with a robot for cooperative learning of scene objects Proceedings of the 7th international conference on Multimodal interfaces, (151-158)
- Mao W and Gratch J Social Judgment in Multiagent Interactions Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems - Volume 1, (210-217)
- Fernández R, Ginzburg J and Lappin S Classifying ellipsis in dialogue Proceedings of the 20th international conference on Computational Linguistics, (240-es)
- Traum D, Rickel J, Gratch J and Marsella S Negotiation over tasks in hybrid human-agent teams for simulation-based training Proceedings of the second international joint conference on Autonomous agents and multiagent systems, (441-448)
- Rickel J, Marcella S, Gratch J, Hill R, Traum D and Swartout W (2002). Toward a New Generation of Virtual Humans for Interactive Experiences, IEEE Intelligent Systems, 17:4, (32-38), Online publication date: 1-Jul-2002.
- Callaway C and Lester J (2002). Narrative prose generation, Artificial Intelligence, 139:2, (213-252), Online publication date: 1-Aug-2002.
- Traum D and Rickel J Embodied agents for multi-party dialogue in immersive virtual worlds Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 2, (766-773)
- Xu W, Xu B, Huang T and Xia H Bridging the gap between dialogue management and dialogue models Proceedings of the 3rd SIGdial workshop on Discourse and dialogue - Volume 2, (201-210)
- Allen J, Blaylock N and Ferguson G A problem solving model for collaborative agents Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 2, (774-781)
- Purver M, Ginzburg J and Healey P On the means for clarification in dialogue Proceedings of the Second SIGdial Workshop on Discourse and Dialogue - Volume 16, (1-10)
- Ginzburg J and Cooper R Resolving ellipsis in clarification Proceedings of the 39th Annual Meeting on Association for Computational Linguistics, (236-243)
- Paek T and Horvitz E Conversation as action under uncertainty Proceedings of the Sixteenth conference on Uncertainty in artificial intelligence, (455-464)
- Matheson C, Poesio M and Traum D Modelling grounding and discourse obligations using update rules Proceedings of the 1st North American chapter of the Association for Computational Linguistics conference, (1-8)
- Nakano Y, Imamura K and Ohara H Taking account of the user's view in 3D multimodal instruction dialogue Proceedings of the 18th conference on Computational linguistics - Volume 1, (572-578)
- Carberry S and Lambert L (1999). A process model for recognizing communicative acts and modeling negotiation subdialogues, Computational Linguistics, 25:1, (1-53), Online publication date: 1-Mar-1999.
- Eckert M and Strube M Resolving discourse deictic anaphora in dialogues Proceedings of the ninth conference on European chapter of the Association for Computational Linguistics, (37-44)
- Lester J, Stone B and Stelling G (1999). Lifelike Pedagogical Agents for Mixed-initiative Problem Solving in Constructivist Learning Environments, User Modeling and User-Adapted Interaction, 9:1-2, (1-44), Online publication date: 1-Jan-1999.
- McGee D, Cohen P and Oviatt S Confirmation in multimodal systems Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics - Volume 2, (823-829)
Index Terms
- A computational theory of grounding in natural language conversation
Recommendations
Symbol Grounding from Natural Conversation for Human-Robot Communication
HAI '17: Proceedings of the 5th International Conference on Human Agent InteractionThis paper proposes a new approach for research on chat-like conversational systems that enable robots to acquire physically grounded knowledge through natural interaction with humans. The proposed approach combines research on chat-like conversational ...
Grounding and turn-taking in multimodal multiparty conversation
HCI'13: Proceedings of the 15th international conference on Human-Computer Interaction: interaction modalities and techniques - Volume Part IVThis study explores the empirical basis for multimodal conversation control acts. Applying conversation analysis as an exploratory approach, we attempt to illuminate the control functions of paralinguistic behaviors in managing multiparty conversation. ...