Exploring the effects of observed physicality conflicts on real-virtual human interaction in augmented reality

ABSTRACT

Augmented reality (AR) enables the illusion of computer-generated virtual objects and humans co-existing with us in the real world. Virtual humans (VHs) in AR can further induce an illusion of physicality in the real world due to their form of presentation and their behavior, such as showing awareness of their surroundings. However, certain behaviors can cause a conflict that breaks this illusion, for example, when we see a VH passing through a physical object.

In this paper we describe a human-subject study that we performed to test the hypothesis that participants experience higher copresence in conflict-free circumstances, and we investigate the magnitude of this effect and behavioral manifestations. Participants perceived a social situation in a room that they shared with a VH as seen through a HoloLens head-mounted display. The behavior of the VH either caused conflicts with (occupied the same space as) physical entities, or avoided them. Our results show that the conflicts in physicality significantly reduced subjective reports of copresence. Moreover, we observed that participants were more likely to cause a conflict (occupy the same space as) virtual entities in case the VH had avoided the conflict. We discuss implications for future research and shared AR setups with real-virtual human interactions.

References

1. Ronald T. Azuma. 1997. A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments 6, 4 (1997), 355--385.
2. Ronard T. Azuma and Gary Bishop. 1994. Improving Static and Dynamic Registration in an Optical See-Through HMD. In Computer Graphics (siggraph 94 conference proceedings ed.). ACM Press, Addison-Wesley, Orlando, FL USA, 197--204.
3. Jeremy N. Bailenson, Jim Blascovich, Andrew C. Beall, and Jack M. Loomis. 2003. Interpersonal distance in immersive virtual environments. Personality and Social Psychology Bulletin 29, 7 (2003), 819--833.
4. Christoph Bartneck, Dana Kulić, Elizabeth Croft, and Susana Zoghbi. 2009. Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. International Journal of Social Robotics 1, 1 (2009), 71--81.
5. Cagatay Basdogan, Chih-Hao Ho, Mandayam A. Srinivasan, and Mel Slater. 2000. An experimental study on the role of touch in shared virtual environments. ACM Transactions on Computer-Human Interaction 7, 4 (2000), 443--460.
6. Norman Blaikie. 2003. Analysing Quantitative Data. London: Sage Publications.
7. Jim Blascovich. 2002. Social Influence within Immersive Virtual Environments. In The Social Life of Avatars, Ralph Schroeder (Ed.). Springer London, 127--145.
8. Jim Blascovich, Jack Loomis, Andrew C. Beall, Kimberly R. Swinth, Crystal L. Hoyt, and Jeremy N. Bailenson. 2002. Immersive virtual environment technology as a methodological tool for social psychology. Psychological Inquiry 13, 2 (apr 2002), 103--124.
9. David E. Breen, Ross T. Whitaker, Eric Rose, and Mihran Tuceryan. 1996. Interactive occlusion and automatic object placement for augmented reality. In Computer Graphics Forum, Vol. 15. Wiley Online Library, 11--22.
10. Changhun Chae and Kwanghee Ko. 2008. Introduction of Physics Simulation in Augmented Reality. In 2008 International Symposium on Ubiquitous Virtual Reality. 37--40.
11. Joon Hao Chuah, Andrew Robb, Casey White, Adam Wendling, Samsun Lampotang, Regis Kopper, and Benjamin Lok. 2013. Exploring Agent Physicality and Social Presence for Medical Team Training. Presence: Teleoperators and Virtual Environments 22, 2 (2013), 141--170.
12. Paul Debevec. 2005. Image-based Lighting. In Proceedings of the ACM Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH) Courses. Article 3, 26--34 pages.
13. Jesse Fox, Sun Joo Ahn, Joris H. Janssen, Leo Yeykelis, Kathryn Y. Segovia, and Jeremy N. Bailenson. 2014. Avatars Versus Agents: A Meta-Analysis Quantifying the Effect of Agency on Social Influence. Human-Computer Interaction 30, 5 (2014), 401--432.
14. Chad Harms and Frank Biocca. 2004. Internal consistency and reliability of the networked minds measure of social presence. In Seventh Annual International Presence Workshop: Presence 2004. 246--251. http://cogprints.org/7026/
15. Thomas Holz, Abraham G. Campbell, Gregory M.P. O'Hare, John W. Stafford, Alan Martin, and Mauro Dragone. 2011. MiRA - Mixed Reality Agents. International Journal of Human-Computer Studies 69, 4 (apr 2011), 251--268.
16. Thomas Holz, Mauro Dragone, and Gregory M.P. O'Hare. 2009. Where robots and virtual agents meet: A survey of social interaction research across milgram's reality-virtuality continuum. International Journal of Social Robotics 1, 1 (2009), 83--93.
17. Dongsik Jo, Ki-Hong Kim, and Gerard Jounghyun Kim. 2015. SpaceTime: adaptive control of the teleported avatar for improved AR tele-conference experience. Computer Animation and Virtual Worlds 26 (2015), 259--269.
18. Kangsoo Kim, Gerd Bruder, Divine Maloney, and Greg Welch. 2016. The Influence of Real Human Personality on Social Presence with a Virtual Human in Augmented Reality. In Proceedings of the Combined International Conference on Artificial Reality & Telexistence and Eurographics Symposium on Virtual Environments (ICAT-EGVE). 115--122.
19. Thomas R. Knapp. 1990. Treating ordinal scales as interval scales: An attempt to resolve the controversy. Nurs. Res. 39 (1990), 121--123.
20. Rensis A. Likert. 1932. A technique for the measurement of attitudes. Arch. Psychol. 22 (1932), 5--55.
21. Jack M. Loomis and Joshua M. Knapp. 2003. Visual Perception of Egocentric Distance in Real and Virtual Environments. In Virtual and Adaptive Environments, L. Hettinger and M. Haas (Eds.). Erlbaum, 21--46.
22. Nadia Magnenat-Thalmann, George Papagiannakis, and Parag Chaudhuri. 2008. Applications of Interactive Virtual Humans in Mobile Augmented Reality. In Encyclopedia of Multimedia (2nd ed.), Borko Furht (Ed.). Springer, 362--368.
23. Microsoft. 2017a. Fragments. http://www.microsoft.com/microsoft-hololens/en-us/apps/Fragments. (September 18 2017).
24. Microsoft. 2017b. Spatial Mapping (Windows Holographic). https://developer.microsoft.com/en-us/windows/holographic/spatial_mapping. (September 18 2017).
25. Isabel Briggs Myers. 1962. The Myers-Briggs Type Indicator: Manual. Consulting Psychologists Press, Palo Alto. ii, 110 pages. http://trove.nla.gov.au/version/25681841
26. Kristine Nowak. 2001. Defining and Differentiating Copresence, Social Presence and Presence as Transportation. In International Workshop on Presence. http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.19.5482
27. Kristine L. Nowak and Frank Biocca. 2003. The effect of the agency and anthropomorphism on users' sense of telepresence, copresence, and social presence in virtual environments. Presence: Teleoperators and Virtual Environments 12, 5 (2003), 481--494. http://www.mitpressjournals.org/doi/abs/10.1162/105474603322761289
28. Mohammad Obaid, Ionut Damian, Felix Kistler, Birgit Endrass, Johannes Wagner, and Elisabeth André. 2012. Cultural Behaviors of Virtual Agents in an Augmented Reality Environment. In International Conference on Intelligent Virtual Agents (Lecture Notes in Computer Science), Yukiko Nakano, Michael Neff, Ana Paiva, and Marilyn Walker (Eds.), Vol. 7502. Springer Berlin Heidelberg, 412--418.
29. Mohammad Obaid, Radoslaw Niewiadomski, and Catherine Pelachaud. 2011. Perception of Spatial Relations and of Coexistence with Virtual Agents. In International Conference on Intelligent Virtual Agents, HannesHögni Vilhjálmsson, Stefan Kopp, Stacy Marsella, and KristinnR. Thórisson (Eds.). Lecture Notes in Computer Science, Vol. 6895. Springer Berlin Heidelberg, 363--369.
30. Tomislav Pejsa, Julian Kantor, Hrvoje Benko, Eyal Ofek, and Andrew Wilson. 2016. Room2Room: Enabling Life-Size Telepresence in a Projected Augmented Reality Environment. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 1716--1725.
31. Mel Slater. 2009. Place Illusion and Plausibility can Lead to Realistic Behaviour in Immersive Virtual Environments. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences 364, 1535 (dec 2009), 3549--3557.
32. Rémy Torre, Pascal Fua, Selim Balcisoy, Michal Ponder, and Daniel Thalmann. 2000. Interaction Between Real and Virtual Humans: Playing Checkers. In Virtual Environments (Eurographics Workshop). 23--32.

Index Terms

• Applied computing

  • Law, social and behavioral sciences

    • Psychology

• Computing methodologies

  • Computer graphics

    • Graphics systems and interfaces

      • Mixed / augmented reality

• Human-centered computing

  • Human computer interaction (HCI)

    • HCI design and evaluation methods

      • User studies

    • Interaction paradigms

      • Mixed / augmented reality