Evaluating dual-view perceptual issues in handheld augmented reality: device vs. user perspective rendering

ABSTRACT

In handheld Augmented Reality (AR) the magic-lens paradigm is typically implemented by rendering the video stream captured by the back-facing camera onto the device's screen. Unfortunately, such implementations show the real world from the device's perspective rather than the user's perspective. This dual-perspective results in misaligned and incorrectly scaled imagery, a predominate cause for the dual-view problem with potential to distort user's spatial perception. This paper presents a user study that analyzes users' expectations, spatial-perception, and their ability to deal with the dual-view problem, by comparing device-perspective and fixed Point-of-View (POV) user-perspective rendering. The results confirm the existence of the dual-view perceptual issue and that the majority of participants expect user-perspective rendering irrespective of their previous AR experience. Participants also demonstrated significantly better spatial perception and preference of the user-perspective view.

References

1. Arthur, K. W., Booth, K. S., and Ware, C. "Evaluating 3D task performance for fish tank virtual worlds," ACM Transactions on Information Systems, vol. 11, no. 3, pp. 239--265, 1993.
2. Asteriadis, S., Karpouzis, K., and Kollias, S., "Head pose estimation with one camera, in uncalibrated environments," In EGIHMI '10, pp. 55--62.
3. Baričević, D., Lee, C., Tobias, H., and Bowman, D.A., "A Hand-Held AR Magic Lens with User-Perspective Rendering," In ISMAR'12, pp. 197--206.
4. Baudisch, P., Good, N., Bellotti, V., and Schraedley, P., "Keeping Things in Context: A Comparative Evaluation of Focus Plus Context Screens, Overviews, and Zooming," In SIGCHI '02, 2002, pp. 259--266.
5. Bier, E.A., Stone, M.C., Pier, K., Buxton, W., and DeRose, T. D., "Toolglass and magic lens: the see- through interface," In SIGGRAPH '93, pp. 73--80.
6. Čopič, P., K., Coulton, P. and Hutchinson, D., Utilizing Sensor Fusion in Markerless Mobile Augmented Reality. In MobileHCI '11, pp. 663--666.
7. Čopič, P., K., Coulton, P., and Alexander, J., "Creating a Stereoscopic Magic-lens to Improve Depth Perception in Handheld Augmented Reality". In MobileHCI '13, pp. 448--451.
8. Cutting, J., "Reconceiving Perceptual Space, in Perceiving Pictures: An Interdisciplinary Approach to Pictorial Space", MIT Press: Cambridge, pp. 215--238, 2003.
9. Hart, S. and Staveland, L., "Development of NASA- TLX (Task Load Index): Results of empirical and theoretical research," Human Mental Workload, 1, 1988.
10. Henze, N., Boll, S., "Who's That Girl? Handheld Augmented Reality for Printed Photo Books", In INTERACT '11, pp. 134--151.
11. Hill, A., Wilson, J., Davidson, B., Gandy, M., and Macintyre, B., "Virtual Transparency: Introducing Parallax View into Video See-through AR," In ISMAR '11, pp. 239--240.
12. Izadi, S., Kim, D., and Hilliges, O., "KinectFusion: Real-time 3D Reconstruction and Interaction Using a Moving Depth Camera," In UIST '11, pp. 559--568.
13. Klein, G. and Murray, D., "Parallel tracking and mapping on a camera phone," In ISMAR '09, pp. 83--86.
14. Kruijff, E. and Ii, J. E. S., "Perceptual Issues in Augmented Reality Revisited," In ISMAR '09, pp. 3--12.
15. Kurz, D. and Benhimane, S., "Gravity-Aware Handheld Augmented Reality," In ISMAR '11, pp. 111--120.
16. Lee, W., Park, Y., Lepetit, V., and Woo, W., "Point-and-shoot for ubiquitous tagging on mobile phones," In ISMAR '10, pp. 57--64.
17. Liao, C., Liu, Q., 13Liew, B., and Wilcox, L., "Pacer: fine-grained interactive paper via camera-touch hybrid gestures on a cell phone," In CHI '10, pp. 2441--2450.
18. Mehra, S., Werkhoven, P., and Worring, M., "Navigating on Handheld Displays: Dynamic versus Static Peephole Navigation," In TOCHI '06, pp. 448--457.
19. Newcombe, R., Lovegrove, S., and Davison, A., "DTAM: Dense tracking and mapping in real-time," In ICCV '11, pp. 2320--2327.
20. Norman, D. A. The Design of Everyday Things. Published by Basic Books, September 17, 2002. ISBN- 10: 0465067107.
21. Oh, J. and Hua, H., "User evaluations on form factors of tangible magic lens," In ISMAR '06, pp. 23--32.
22. Olsson T., and Salo M., "Online user survey on current mobile augmented reality applications". In ISMAR '11, pp. 75--84.
23. Robbins, D. C., Cutrell E., Sarin R., and Horvitz E., "ZoneZoom: map navigation for smartphones with recursive view segmentation," In AVI '04, 2004, pp. 231--234.
24. Rohs, M., Schöning, M., Raubal, G., Essl, and A. Krüger, "Map Navigation with Mobile Devices: Virtual versus Physical Movement with and without Visual Context Categories and Subject Descriptors," In ICMI' 07, pp. 146--153.
25. Rohs, M., Schöning, J., Schleicher, R., Essl, G., Naumann, A., and Krüger, A., "Impact of Item Density on Magic Lens Interactions," In MobileHCI '09, pp. 1--4.
26. Wagner, D., Reitmayr, G., Mulloni, A., Drummond, T., and Schmalstieg, D., "Pose tracking from natural features on mobile phones," In ISMAR '08, pp. 125--134.

Index Terms

• Information systems

  • Information systems applications

    • Multimedia information systems