Helen Hastie
David A. Robb
ABSTRACT
We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.
- M. L. Cummings. 2004. The Need for Command and Control Instant Message Adaptive Interfaces: Lessons Learned from Tactical Tomahawk Human-in-the-Loop Simulations. Cyberpsychology and behaviour 7, 6 (2004).Google Scholar
- H. Hastie, X. Liu, and P. Patron. 2016. A Demonstration of Multimodal Debrief Generation for AUVs, Post-mission and In-mission. In Proceedings of ICMI. Google ScholarDigital Library
- H. Hastie, X. Liu, and P. Patron. 2017. Trust Triggers for Multimodal Command and Control Interfaces. In Proceedings of ICMI. Google ScholarDigital Library
- E. W. Medina, S. Fugate, L. Duffy, D. Magsombol, O. Amezcua, G. Rogers, and M.G. Ceruit. 2007. Next-generation tactical-situation-assessment technology (TSAT): Chat. In Lecture notes in Computer Science, L. Baresi, P. Fraternali, and G.J. Houben (Eds.). Berlin: Springer-Verlag, 526–532. Google ScholarDigital Library
- I. V. Serban, R. Lowe, L. Charlin, and J. Pineau. 2016. Generative Deep Neural Networks for Dialogue: A Short Review. (2016).Google Scholar
- https://arxiv.org/pdf/1611.06216.Google Scholar
- pdfGoogle Scholar
- O. Vinyals and Q. Le. 2015. A neural conversational model. arXiv preprint arXiv:1506.05869 (2015).Google Scholar
- Abstract 1 Introduction 2 Demonstration 3 System Architecture Acknowledgments ReferencesGoogle Scholar
Index Terms
- MIRIAM: a multimodal chat-based interface for autonomous systems
Recommendations
Keep Me in the Loop: Increasing Operator Situation Awareness through a Conversational Multimodal Interface
ICMI '18: Proceedings of the 20th ACM International Conference on Multimodal InteractionAutonomous systems are designed to carry out activities in remote, hazardous environments without the need for operators to micro-manage them. It is, however, essential that operators maintain situation awareness in order to monitor vehicle status and ...
MIRIAM: A Multimodal Interface for Explaining the Reasoning Behind Actions of Remote Autonomous Systems
ICMI '18: Proceedings of the 20th ACM International Conference on Multimodal InteractionAutonomous systems in remote locations have a high degree of autonomy and there is a need to explain what they are doing and why , in order to increase transparency and maintain trust. This is particularly important in hazardous, high-risk scenarios. ...
Embodiment in conversational interfaces: Rea
CHI '99: Proceedings of the SIGCHI conference on Human Factors in Computing SystemsIn this paper, we argue for embodied corrversational characters as the logical extension of the metaphor of human - computer interaction as a conversation. We argue that the only way to fully model the richness of human I&+ to-face communication is to rely ...
Comments