Atef Ben-Youssef
ABSTRACT
In this paper, we present a new dataset of spontaneous interactions between a robot and humans, of which 54 interactions (between 4 and 15-minute duration each) are freely available for download and use. Participants were recorded while holding spontaneous conversations with the robot Pepper. The conversations started automatically when the robot detected the presence of a participant and kept the recording if he/she accepted the agreement (i.e. to be recorded). Pepper was in a public space where the participants were free to start and end the interaction when they wished. The dataset provides rich streams of data that could be used by research and development groups in a variety of areas.
- Jeremy Ang, Rajdip Dhillon, Ashley Krupski, Elizabeth Shriberg, and Andreas Stolcke. 2002. Prosody-Based Automatic Detection Of Annoyance And Frustration In Human-Computer Dialog. In in Proc. ICSLP 2002. 2037–2040.Google Scholar
- Salvatore M. Anzalone, Sofiane Boucenna, Serena Ivaldi, and Mohamed Chetouani. 2015. Evaluating the Engagement with Social Robots. International Journal of Social Robotics 7, 4 (aug 2015), 465–478.Google ScholarCross Ref
- ROGER G. BARKER. 1938. The Effect of Frustration upon the Cognitive Ability. Journal of Personality 7, 2 (dec 1938), 145–150. 1938.tb02284.xGoogle Scholar
- Dan Bohus and Eric Horvitz. 2014. Managing Human-Robot Engagement with Forecasts and... um... Hesitations. In Proceedings of the 16th International Conference on Multimodal Interaction - ICMI ’14. ACM Press, New York, New York, USA, 2–9. Google ScholarDigital Library
- Hynek Boril, Seyed Omid Sadjadi, Tristan Kleinschmidt, and John H L Hansen. 2010. Analysis and detection of cognitive load and frustration in drivers’ speech. In Proceedings of {INTERSPEECH}. Makuhari Messe International Convention Complex, Chiba, Makuhari, Japan, 502–505.Google Scholar
- Nigel Bosch and Sidney D’Mello. 2015. The Affective Experience of Novice Computer Programmers. International Journal of Artificial Intelligence in Education (oct 2015), 1–26.Google ScholarCross Ref
- P T Costa, R R McCrae, and Inc Psychological Assessment Resources. 1992. Revised NEO Personality Inventory (NEO PI-R) and NEO Five-Factor Inventory (NEO-FFI). Psychological Assessment Resources. https://books.google.co.in/ books?id=mp3zNwAACAAJGoogle Scholar
- John W Creswell. 2013. Research design: Qualitative, quantitative, and mixed methods approaches. Sage publications.Google Scholar
- Sidney D’Mello and Art Graesser. 2012. Dynamics of affective states during complex learning. Learning and Instruction 22, 2 (2012), 145–157. UE-HRI: A New Dataset for the Study of User Engagement in Spontaneous ... ICMI’17, November 13–17, 2017, Glasgow, UKGoogle ScholarCross Ref
- P. Dybala, M. Ptaszynski, R. Rzepka, and K. Araki. 2009. Activating humans with humor - A dialogue system that users want to interact with. IEICE Transactions on Information and Systems E92-D (2009), 2394–2401. Issue 12.Google Scholar
- Lynne Hall, Sarah Woods, Ruth Aylett, Lynne Newall, and Ana Paiva. 2005. Achieving empathic engagement through affective interaction with synthetic characters. In Affective computing and intelligent interaction. Springer, 731–738. Google ScholarDigital Library
- Ryuichiro Higashinaka, Kotaro Funakoshi, Yuka Kobayashi, and Michimasa Inaba. 2016. The dialogue breakdown detection challenge: Task description, datasets, and evaluation metrics. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016). European Language Resources Association (ELRA), Paris, France.Google Scholar
- Serena Ivaldi, Sebastien Lefort, Jan Peters, Mohamed Chetouani, Joelle Provasi, and Elisabetta Zibetti. 2017. Towards Engagement Models that Consider Individual Factors in HRI: On the Relation of Extroversion and Negative Attitude Towards Robots to Gaze and Speech During a HumanâĂŞRobot Assembly Task. International Journal of Social Robotics 9, 1 (jan 2017), 63–86.Google ScholarCross Ref
- Iolanda Leite, Marissa McCoy, Daniel Ullman, Nicole Salomons, and Brian Scassellati. 2015. Comparing Models of Disengagement in Individual and Group Interactions. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction - HRI ’15. ACM Press, New York, New York, USA, 99–105. Google ScholarDigital Library
- Marwa Mahmoud, Tadas Baltrušaitis, Peter Robinson, and Laurel Riek. 2011. 3D corpus of spontaneous complex mental states. In Conference on Affective Computing and Intelligent Interaction. Google ScholarDigital Library
- Gary McKeown, Michel F. Valstar, Roderick Cowie, and Maja Pantic. 2010. The SEMAINE corpus of emotionally coloured character interactions. In 2010 IEEE International Conference on Multimedia and Expo. IEEE, 1079–1084.Google ScholarCross Ref
- org/10.1109/ICME.2010.5583006Google Scholar
- Tatsuya Nomura, Takayuki Kanda, and Tomohiro Suzuki. Experimental investigation into influence of negative attitudes toward robots on humanâĂŞrobot interaction. (????).Google Scholar
- Christopher Peters, Ginevra Castellano, and Sara de Freitas. 2009. An exploration of user engagement in HCI. In Proceedings of the International Workshop on Affective-Aware Virtual Agents and Social Robots. ACM, 9. Google ScholarDigital Library
- I Poggi. 2007. Mind, Hands, Face and Body: A Goal and Belief View of Multimodal Communication. Weidler Buchverlag Berlin.Google Scholar
- Charles Rich, Brett Ponsler, Aaron Holroyd, and Candace L. Sidner. 2010. Recognizing engagement in human-robot interaction. In 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 375–382. Google ScholarDigital Library
- KR Scherer. 1994. Affect bursts. Emotions: Essays on emotion theory (1994). https://books.google.fr/books?hl=frGoogle Scholar
- Marc Schröder. 2003. Experimental study of affect bursts. Speech Communication 40, 1 (2003), 99–116. Google ScholarDigital Library
- Candace L. Sidner, Christopher Lee, Cory D. Kidd, Neal Lesh, and Charles Rich. 2005. Explorations in engagement for humans and robots. Artificial Intelligence 166, 1-2 (aug 2005), 140–164. Google ScholarDigital Library
- Dominique Vaufreydaz, Wafa Johal, and Claudine Combe. 2016. Starting engagement detection towards a companion robot using multimodal features. Robotics and Autonomous Systems 75 (jan 2016), 4–16. 01.004 Google ScholarDigital Library
- Johannes Wienke, David Klotz, and Sebastian Wrede. 2012. A Framework for the Acquisition of Multimodal Human-Robot Interaction Data Sets with a Whole-System Perspective. LREC 2012 Workshop on Multimodal Corpora for Machine Learning (2012).Google Scholar
Index Terms
- UE-HRI: a new dataset for the study of user engagement in spontaneous human-robot interactions
Recommendations
Increasing user engagement with distributed public displays through the awareness of peer interactions
PerDis '15: Proceedings of the 4th International Symposium on Pervasive DisplaysRecent developments have shown a growing interest in interactive pervasive computing scenarios supported by public displays as well as their introduction into educational environments. Still, one of the biggest challenges in the design of public display ...
HRI Workshop on Human-Robot Teaming
HRI'15 Extended Abstracts: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended AbstractsDeveloping collaborative robots that can productively and safely operate out of isolation in uninstrumented, human-populated environments is an important goal for the field of robotics. The development of such agents, those that handle the dynamics of ...
User experience of human-robot long-term interactions
HAI '22: Proceedings of the 10th International Conference on Human-Agent InteractionSince interactions with social robots are novel and exciting for many people, one particular concern in this specific area of human-robot interaction (HRI) is the extent to which human users will experience the interactions positively over time, when ...
Comments