Multi-modal exploration of small artifacts: an exhibition at the Gold Museum in Bogota

ABSTRACT

We present the iterative development and initial evaluation of a multi-modal platform for interacting with precious small artifacts from the Gold Museum in Bogota. By using a commercial haptic interface, loud speakers, and stereo displays, one can allow visitors to touch, hear, and observe in stereo those precious artifacts. We use this multi-modal interface in a novel way and in a novel context in order to provide virtual replicas that can be weighed, cleaned, and explored as if they were close to a visitor's hand. This platform is currently open to the public, and some of the lessons learned are reported in terms of usability in a real-world museum application.

References

1. Asano, T., Ishibashi, Y., Minezawa, S., and Fujimoto, M. 2005. Surveys of exhibition planners and visitors about a distributed haptic museum. In ACE '05: Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology, ACM, New York, NY, USA, 246--249.
2. Bergamasco, M., Frisoli, A., and Barbagli, F. 2002. Haptics technologies and cultural heritage applications. In CA '02: Proceedings of the Computer Animation, IEEE Computer Society, Washington, DC, USA, 25.
3. Brewster, S. 2001. The impact of haptic 'touching' technology on cultural applications. In In proceedings of EVA'01, 1--14.
4. Burke, J. L., Prewett, M. S., Gray, A. A., Yang, L., Stilson, F. R. B., Coovert, M. D., Elliot, L. R., and Redden, E. 2006. Comparing the effects of visual-auditory and visual-tactile feedback on user performance: a meta-analysis. In ICMI '06: Proceedings of the 8th international conference on Multimodal interfaces, ACM, New York, NY, USA, 108--117.
5. Butler, M., and Neave, P. 2008. Object appreciation through haptic interaction. In Hello! Where are you in the landscape of educational technology? Proceedings ascilite Melbourne 2008, Ascilite, 133--141. http://www.ascilite.org.au/conferences/melbourne08/procs/butler-m.pdf.
6. Cholewiak, S. A., Tan, H. Z., and Ebert, D. S. 2008. Haptic identification of stiffness and force magnitude. In HAPTICS '08: Proceedings of the 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, IEEE Computer Society, Washington, DC, USA, 87--91.
7. Christou, C., Angus, C., Loscos, C., Dettori, A., and Roussou, M. 2006. A versatile large-scale multimodal vr system for cultural heritage visualization. In VRST '06: Proceedings of the ACM symposium on Virtual reality software and technology, ACM, New York, NY, USA, 133--140.
8. Corbett, R., van den Doel, K., Lloyd, J. E., and Heidrich, W. 2007. Timbrefields: 3d interactive sound models for real-time audio. Presence: Teleoper. Virtual Environ. 16, 6, 643--654.
9. Laycock, R. G., Laycock, S. D., and Day, A. M. 2006. Haptic Navigation and Exploration of High Quality Pre-rendered Environments. Eurographics Association, Nicosia, Cyprus, M. Ioannides, D. Arnold, F. Niccolucci, and K. Mania, Eds., 17--24.
10. McLaughlin, M. L., Sukhatme, G., Shahabi, C., Hespanha, J., Ortega, A., and Medioni, G. 2000. The haptic museum. In Proceedings of the EVA 2000 Conference on Electronic Imaging and the Visual Arts.
11. Pai, D. K., Doel, K. v. d., James, D. L., Lang, J., Lloyd, J. E., Richmond, J. L., and Yau, S. H. 2001. Scanning physical interaction behavior of 3d objects. In SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, ACM, New York, NY, USA, 87--96.
12. Petridis, P., Pletinckx, D., and White, K. M. M. 2006. The epoch multimodal interface for interacting with digital heritage artefacts. In Interactive Technologies and Sociotechnical Systems, Springer Berlin / Heidelberg, Berlin, 408--417.
13. Sensegraphics, 2009. H3d.org open source haptics. http://www.h3dapi.org.
14. Shneiderman, B., Plaisant, C., Cohen, M., and Jacobs, S. 2009. Designing the User Interface: Strategies for Effective Human-Computer Interaction, 5th ed. Addison Wesley.
15. Tecchia, F., Ruffaldi, E., Frisoli, A., Bergamasco, M., and Carrozzino, M. 2007. Multimodal interaction for the web. In Museums and the Web 2007: Proceedings, J. Trant and D. Bearman, Eds., Archives&Museum Informatics. http://www.archimuse.com/mw2007/papers/tecchia/tecchia.html.
16. Walczak, K., and White, M. 2003. Cultural heritage applications of virtual reality. In Web3D '03: Proceedings of the eighth international conference on 3D Web technology, ACM, New York, NY, USA, 182--183.
17. Wikipedia, 2009. Kruskal-wallis one-way analysis of variance. http://en.wikipedia.org/wiki/Kruskal-Wallis_one-way_analysis_of_variance.
18. Wojciechowski, R., Walczak, K., White, M., and Cellary, W. 2004. Building virtual and augmented reality museum exhibitions. In Web3D '04: Proceedings of the ninth international conference on 3D Web technology, ACM, New York, NY, USA, 135--144.

Index Terms

• Applied computing

  • Arts and humanities

  • Document management and text processing

    • Document capture

      • Graphics recognition and interpretation

• Computing methodologies

  • Computer graphics

    • Graphics systems and interfaces

      • Virtual reality

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Graphics input devices