AudioCubes: a distributed cube tangible interface based on interaction range for sound design

ABSTRACT

AudioCubes is a novel tangible user interface allowing any person interested by sound design such as sound creators, and music trainers to intuitively explore and create dynamically changing sound. A new sound is created by manipulating distributed cube tangible user interface that can be coupled wirelessly by locating them in the interaction range of each other on a table. At any time, a sound processing network combines operational properties of AudioCubes, such as location on a plane or in space, movement, arrangement with other cubes, and layout. Sound algorithm parameters and the configuration of the sound processing network can be changed simultaneously, allowing a fast and convenient exploration of sound creation space that creates a new interaction technique for creating sounds.

References

1. Arfib, D. and Dudon J. A Digital Emulator of the Photosonic Instrument. Proc. of NIME;02, NIME Org. (2002).
2. Bérard, F. Vision par ordinateur pour l'interaction homme-machine fortement couplée. PhD thesis, Grenoble (1999).
3. Berry, R., Makino, M., Hikawa, N., and Suzuki, M. The Augmented Composer Project: The Music Table. Proc. of ISMAR'03, IEEE Computer Society Press, 338--339.
4. Coutaz, J. and Rey, G Foundations for a Theory of Contextors. Proc. of CADUI'2002, Kluwer, Drodrecht (2002), 13--34.
5. Coutaz, J., Borkowski, S., and Barralon, N. Coupling Interaction Resources: an Analytical Model. Proc. of EUSAI'2005.
6. Fishkin, K. P. A taxonomy for and analysis of tangible interfaces. Personal and Ubiquitous Comp. 8, 5 (2004) 347--358.
7. Hunt, A., Wanderley, M. M., and Paradis, M. The Importance of Parameter Mapping in Electronic Instrument Design. Proc. of NIME'02, NIME Org. (2002), 1--6.
8. Jaffe, E., Dayan, A., and Dekel, A. Cube management system: a tangible interface for monitoring large scale systems. Proc. of CHIMIT'07, ACM Press, New York (2007).
9. Jordà, S., Geiger, G., Alonso, M., and Kaltenbrunner, M. The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces. Proc. of TEI'2007.
10. Kranz, M., Schmidt, D., Holleis, P., and Schmidt, A. A Display Cube as a Tangible User Interface. Adj. Proc. of Ubi-Comp'2005, Springer, Berlin (2005).
11. Marquardt, N. and Greenberg, S. Distributed Physical Interfaces With Shared Phidgets. Proc. of TEI'2007, 13--20.
12. Newton-Dunn, H., Nakano, H., and Gibson, J. Block Jam: A Tangible Interface for Interactive Music. Proc. of NIME'03.
13. Paradiso, J. A., Hsiao, K., and Benbasat, A. Tangible Music Interfaces Using Passive Magnetic Tags. Proc. of NIME'01. ACM CHI'2001 Workshop, ACM Press, New York (2001).
14. Patten, J. and Ishii, H. A Comparison of Spatial Organization Strategies in Graphical and Tangible User Interfaces. Proc. of DARE'00, ACM Press, New York (2000), 41--50.
15. Poupyrev, I., Berry, R., Kurumisawa, J., Billinghurst, M., Airola, C., and Kato, H. Augmented Groove: Collaborative Jamming in Augmented Reality. Proc. of Conference Abstracts and Applications, ACM Press, New York (2000), 77.
16. Rekimoto, J., Ullmer, B., and Oba, H. DataTiles: A Modular Platform for Mixed Physical and Graphical Interactions. Proc. of CHI'2001. ACM Press, New York (2001), 269--276.
17. Ronveaux, A. and Saint Aubin, Y. Harmonic polynomials invariant under a finite subgroup of O(n), Journal of Mathematical Physics 24, 5 (1983), 1037--1040.
18. Salem, B. and Peeters, H. InterCUBE: A study into merging action and interaction spaces. Proc. of Interact'2007, 57--70.
19. Sharlin, E., Itoh, Y., Watson, B., Kitamura, Y., Sutphen, S., and Liu, L. Cognitive cubes: a tangible user interface for cognitive assessment. Proc. of CHI'02, ACM Press, 347--354.
20. Sheridan, J., Short, B., Van Laerhoven, K., Villar, N., and Kortuem, G. Exploring Cube Affordances: Towards A Classification of Non-Verbal Dynamics of Physical Interfaces for Wearable Computing. Proc. of IEE Eurowearable'2003.
21. Song, H., Guimbretière, F., Ambrose, M. A., and Lostritto, C. CubeExplorer: An Evaluation of Interaction Techniques in Architectural Education. Proc. of Interact'2007, 43--56.
22. Suzuki, H. and H. Kato. Interaction-Level Support for Collaborative Learning: AlgoBlock. Proc. of CSCL'95, 349--355.
23. Terrenghi, L., Kranz, M., Holleis, P., and Schmidt, A. cube to learn: a TUI for the design of a learning appliance. Personal and Ubiquitous Comp. 10, 2-3 (2006), 153--158.
24. Ullmer, B., Ishii, H., and Glas, D. Mediablocks: Physical Containers, Transports, and Controls for Online Media. Proc. of SIGGRAPH'98, ACM Press, New York (1998), 379--386.
25. Ullmer, B. and Ishii, H. Emerging Frameworks for Tangible User Interfaces. IBM Systems 39, 3 & 4 (2000) 905--931.
26. Ullmer, B., Ishii, H., and Jacob, R. J. K. Token+Constraint Systems for Tangible Interaction with Digital Information. ACM Trans. on Computer-Human Interaction 12, 1 (2005), 81--118.
27. Van Laerhoven, K,. Villar, N., Schmidt, A., Kortuem, G., and Gellersen, H. Using an Autonomous Cube for Basic Navigation and Input. Proc. of ICMI/PUI 2003, 203--210.
28. Watanabe, R., Itoh, Y., Asai, M., Kitamura, Y., Kishino, F., and Kikuchi, H. The soul of ActiveCube: implementing a flexible, multimodal, three-dimensional spatial tangible interface. Proc. of ACE'04, 173--180.
29. Zhou, Z. Y., Horng, P. J., Cheok, A. D., and Li, Y. 3D Story Cube: an Interactive TUI for Storytelling with 3D Graphics and Audio. Personal Ubiquitous Comp. 8, 5 (2004) 374--376.

Index Terms

• Applied computing

  • Arts and humanities

• Hardware

  • Communication hardware, interfaces and storage

    • Signal processing systems

  • Robustness

    • Hardware reliability

      • Signal integrity and noise analysis

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Touch screens

    • Interaction paradigms

      • Natural language interfaces

  • Interaction design

    • Interaction design process and methods

      • Interface design prototyping

      • User centered design

• Information systems

  • Information retrieval

    • Specialized information retrieval

      • Multimedia and multimodal retrieval

        • Speech / audio search