Improving freehand placement for grasping virtual objects via dual view visual feedback in mixed reality

ABSTRACT

This paper presents a first study into the use of dual view visual feedback in an exocentric MR environment for assisting freehand grasping of virtual objects. Recent work has highlighted problems associated with user errors in freehand grasping, via an analysis of virtual object type, location and size. Our work presents an extension to this, where 30 participants are recruited for two experiments (one assessing object size and the second object position), giving 1710 grasps in total. We report on results following the same protocol of the aforementioned study using a dual view visual feedback method. Results show that dual view visual feedback significantly increases user z placement accuracy and improves grasp placement in the x and y axes, however completion time is significantly higher. No improvement was found in user grasp aperture using dual view visual feedback for changes in object size and position.

References

1. Al-Kalbani, M., Williams, I., and Maite, F.-P. 2016. Analysis of Medium Wrap Freehand Virtual Object Grasping in Exocentric Mixed Reality. IEEE ISMAR.
2. Benko, H., Wilson, A. D., and Zannier, F. 2014. Dyadic projected spatial augmented reality. In ACM UIST, 645--655.
3. Feix, T., Bullock, I. M., and Dollar, A. M. 2014. Analysis of Human Grasping Behavior: Correlating Tasks, Objects and Grasps. IEEE Transactions on Haptics 7, 3, 311--323.
4. Hoang, T., and Thomas, B. H. 2011. Multiple Camera Augmented Viewport: An Investigation of Camera Position, Visualizations, and the Effects of Sensor Errors and Head Movement. PhD thesis, Virtual Reality Society of Japan.
5. Jones, B., Sodhi, R., Murdock, M., Mehra, R., Benko, H., Wilson, A., Ofek, E., MacIntyre, B., Raghuvanshi, N., and Shapira, L. 2014. Roomalive: Magical experiences enabled by scalable, adaptive projector-camera units. In ACM UIST, 637--644.
6. Maria, K., Filippeschi, A., Ruffaldi, E., Shorr, Y., and Gopher, D. 2015. Evaluation of multimodal feedback effects on the time-course of motor learning in multimodal vr platform for rowing training. In IEEE ICVR, 158--159.
7. Mason, A. H., Walji, M. A., Lee, E. J., and MacKenzie, C. L. 2001. Reaching movements to augmented and graphic objects in virtual environments. In Proceedings of the SIGCHI conference on Human factors in computing systems, ACM, 426--433.
8. Pitts, M. J., Burnett, G., Skrypchuk, L., Wellings, T., Attridge, A., and Williams, M. A. 2012. Visual---haptic feedback interaction in automotive touchscreens. Displays 33, 1, 7--16.
9. Prattichizzo, D., Pacchierotti, C., and Rosati, G. 2012. Cutaneous force feedback as a sensory subtraction technique in haptics. IEEE Transactions on Haptics 5, 4, 289--300.
10. Sutherland, C., Hashtrudi-Zaad, K., Sellens, R., Abolmaesumi, P., and Mousavi, P. 2013. An augmented reality haptic training simulator for spinal needle procedures. IEEE Transactions on Biomedical Engineering 60, 11, 3009--3018.

Index Terms

• Computing methodologies

  • Computer graphics

    • Graphics systems and interfaces

      • Mixed / augmented reality

• Human-centered computing

  • Human computer interaction (HCI)

    • HCI design and evaluation methods

      • Usability testing

      • User studies

    • Interaction techniques

  • Interaction design

    • Interaction design process and methods

      • User centered design