CarVR: Enabling In-Car Virtual Reality Entertainment

ABSTRACT

Mobile virtual reality (VR) head-mounted displays (HMDs) allow users to experience highly immersive entertainment whilst being in a mobile scenario. Long commute times make casual gaming in public transports and cars a common occupation. However, VR HMDs can currently not be used in moving vehicles since the car's rotation affects the HMD's sensors and simulator sickness occurs when the visual and vestibular system are stimulated with incongruent information. We present CarVR, a solution to enable VR in moving vehicles by subtracting the car's rotation and mapping vehicular movements with the visual information. This allows the user to actually feel correct kinesthetic forces during the VR experience. In a user study (n = 21), we compared CarVR inside a moving vehicle with the baseline of using VR without vehicle movements. We show that the perceived kinesthetic forces caused by CarVR increase enjoyment and immersion significantly while simulator sickness is reduced compared to a stationary VR experience. Finally, we explore the design space of in-car VR entertainment applications using real kinesthetic forces and derive design considerations for practitioners.

References

1. 2016. Developer Center - Documentation and SDKs | Oculus. (2016). https://developer.oculus.com/documentation/intro-vr/latest/concepts/bp_intro/
2. 2016. Lockheed Martin school bus takes you on virtual journey to Mars. (2016). http://generation-beyond.com/mars-experience
3. Mahdi Azmandian, Mark Hancock, Hrvoje Benko, Eyal Ofek, and Andrew D Wilson. 2016. Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1968--1979.
4. John Bichard, Liselott Brunnberg, Marco Combetto, Anton Gustafsson, and Oskar Juhlin. 2006. Backseat Playgrounds: Pervasive Storytelling in Vast Location Based Games. Springer Berlin Heidelberg, Berlin, Heidelberg, 117--122. DOI: http://dx.doi.org/10.1007/11872320_14
5. Willem Bles, Jelte E. Bos, and Hans Kruit. 2000. Motion sickness. Current opinion in neurology 13, 1 (2000), 19--25.
6. Dipl-Ing Thomas Bock, Prof Dr-Ing Markus Maurer, Dipl-Ing Franciscus van Meel, and Dipl-Ing Thomas Müller. 2008. Vehicle in the Loop. 110, 1 (2008), 10--16. DOI: http://dx.doi.org/10.1007/BF03221943
7. Liselott Brunnberg, Oskar Juhlin, and Anton Gustafsson. 2009. Games for Passengers: Accounting for Motion in Location-based Applications. In Proceedings of the 4th International Conference on Foundations of Digital Games (FDG '09). ACM, New York, NY, USA, 26--33. DOI: http://dx.doi.org/10.1145/1536513.1536528
8. Lung-Pan Cheng, Patrick Lühne, Pedro Lopes, Christoph Sterz, and Patrick Baudisch. 2014. Haptic turk: a motion platform based on people. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 3463--3472.
9. Francis B. Colavita. 1974. Human sensory dominance. Perception & Psychophysics 16, 2 (1974), 409--412.
10. Fabien Danieau, Julien Fleureau, Philippe Guillotel, Nicolas Mollet, Anatole Lecuyer, and Marc Christie. HapSeat: Producing Motion Sensation with Multiple Force-feedback Devices Embedded in a Seat. In Proceedings of the 18th ACM Symposium on Virtual Reality Software and Technology (2012) (VRST '12). ACM, 69--76. DOI: http://dx.doi.org/10.1145/2407336.2407350
11. Albert Einstein and others. 1911. On the Influence of Gravitation on the Propagation of Light. Annalen der Physik 35, 898--908 (1911), 906.
12. Ajoy S. Fernandes and Steven K. Feiner. 2016. Combating VR sickness through subtle dynamic field-of-view modification. In 2016 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 201--210.
13. James J. Gibson. 2014. The ecological approach to visual perception: classic edition. Psychology Press.
14. Jan Gugenheimer, Dennis Wolf, Gabriel Haas, Sebastian Krebs, and Enrico Rukzio. 2016. SwiVRChair: A Motorized Swivel Chair to Nudge Users? Orientation for 360 Degree Storytelling in Virtual Reality. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1996--2000. DOI: http://dx.doi.org/10.1145/2858036.2858040
15. Lawrence J. Hettinger, Kevin S. Berbaum, Robert S. Kennedy, William P. Dunlap, and Margaret D. Nolan. 1990. Vection and simulator sickness. Military Psychology 2, 3 (1990), 171.
16. Makoto Igarashi, F. Owen Black, and Includes Index. 1985. Vestibular and Visual Control on Posture and Locomotor Equilibrium. (1985).
17. Jaguar New Zealand. 2015. Jaguar creates Actual Reality prank. (2015). https://www.youtube.com/watch?v=_zpx0Eb1Tvo
18. Robert S. Kennedy, Norman E. Lane, Kevin S. Berbaum, and Michael G. Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology 3, 3 (1993), 203--220.
19. Eugenia M. Kolasinski. 1995. Simulator Sickness in Virtual Environments. Technical Report. DTIC Document.
20. Camille Koppen and Charles Spence. 2007. Seeing the light: exploring the Colavita visual dominance effect. Experimental brain research 180, 4 (2007), 737--754.
21. J. J. W. Lin, H. B. L. Duh, D. E. Parker, H. Abi-Rached, and T. A. Furness. 2002. Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment. In Virtual Reality, 2002. Proceedings. IEEE. 164--171. DOI: http://dx.doi.org/10.1109/VR.2002.996519
22. Daniel Michaels. 2016. Roller Coasters Ride Into Dizzying Realm of Virtual Reality. (2016). http://goo.gl/qnzsCL
23. Akihiro Morimoto, Naoki Isu, Daisuke Ioku, Hitoshi Asano, Atsuo Kawai, and Fumito Masui. 2008. Effects of reading books and watching movies on inducement of car sickness. In Proc. of FISITA 2008 World Automotive Congress, in print.
24. Oculus VR, LLC. 2016. Virtual Reality Best Practices. (2016). https://docs.unrealengine.com/latest/INT/Platforms/VR/ContentSetup/
25. James T. Reason and Joseph John Brand. 1975. Motion sickness. Academic press.
26. Max Rheiner. 2014. Birdly an Attempt to Fly. In ACM SIGGRAPH 2014 Emerging Technologies (SIGGRAPH '14). ACM, New York, NY, USA, Article 3, 1 pages. DOI: http://dx.doi.org/10.1145/2614066.2614101
27. Rose Marie Rine, Michael C. Schubert, and Thomas J. Balkany. 1999. Visual-vestibular habituation and balance training for motion sickness. Physical therapy 79, 10 (1999), 949--957.
28. Arnon Rolnick and R. E. Lubow. 1991. Why is the driver rarely motion sick? The role of controllability in motion sickness. Ergonomics 34, 7 (1991), 867--879.
29. C. Schatzschneider, G. Bruder, and F. Steinicke. 2016. Who turned the clock? Effects of Manipulated Zeitgebers, Cognitive Load and Immersion on Time Estimation. 22, 4 (2016), 1387--1395. DOI: http://dx.doi.org/10.1109/TVCG.2016.2518137
30. Adalberto L. Simeone, Eduardo Velloso, and Hans Gellersen. 2015. Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3307--3316. DOI: http://dx.doi.org/10.1145/2702123.2702389
31. Mel Slater, John McCarthy, and Francesco Maringelli. 1998. The influence of body movement on subjective presence in virtual environments. Human Factors: The Journal of the Human Factors and Ergonomics Society 40, 3 (1998), 469--477.
32. Mel Slater, Martin Usoh, and Anthony Steed. 1994. Depth of presence in virtual environments. Presence: Teleoperators & Virtual Environments 3, 2 (1994), 130--144.
33. Mel Slater, Martin Usoh, and Anthony Steed. 1995. Taking steps: the influence of a walking technique on presence in virtual reality. ACM Transactions on Computer-Human Interaction (TOCHI) 2, 3 (1995), 201--219.
34. Richard H. Y. So, W. T. Lo, and Andy T. K. Ho. 2001. Effects of navigation speed on motion sickness caused by an immersive virtual environment. Human Factors: The Journal of the Human Factors and Ergonomics Society 43, 3 (2001), 452--461.
35. Kay M. Stanney, Kelly S. Hale, Isabelina Nahmens, and Robert S. Kennedy. 2003. What to expect from immersive virtual environment exposure: Influences of gender, body mass index, and past experience. Human Factors: The Journal of the Human Factors and Ergonomics Society 45, 3 (2003), 504--520.
36. Petra Sundström, Axel Baumgartner, Elke Beck, Christine Döttlinger, Martin Murer, Ivana Randelshofer, David Wilfinger, Alexander Meschtscherjakov, and Manfred Tscheligi. 2014. Gaming to Sit Safe: The Restricted Body As an Integral Part of Gameplay. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS '14). ACM, New York, NY, USA, 715--724. DOI: http://dx.doi.org/10.1145/2598510.2600882
37. Mark Turner and Michael J. Griffin. 1999. Motion sickness in public road transport: the relative importance of motion, vision and individual differences. British Journal of Psychology 90, 4 (1999), 519--530.
38. Robert Xiao and Hrvoje Benko. 2016. Augmenting the Field-of-View of Head-Mounted Displays with Sparse Peripheral Displays. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1221--1232.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)