Tangible Signals - Physical Representation of Sound and Haptic Control Feedback

ABSTRACT

This paper describes the Ph.D. research project "Tangible Signals" which is currently in its initial phase. This project investigates the dynamic physical representation and haptic feedback control of computer music and sound data using motorized and augmented objects. The research focuses on artistic and performative contributions that this approach offers. Special attention is given to the collaboration with visually impaired people, as they are very limited in the use of exclusively GUI-based interaction. On the following pages the background of the project will be described and methods, research questions and work progress will be presented.

References

1. Peter Bennett and Sile O'Modhrain. 2008. The BeatBearing: a tangible rhythm sequencer. In Proceedings of NordiCHI 2008: 5th Nordic Conference on Computer-Human Interaction, Vol. 2008. 1--12.
2. Aubrey Colter, Patlapa Davivongsa, Donald Derek Haddad, Halla Moore, Brian Tice, and Hiroshi Ishii. 2016. SoundFORMS : Manipulating Sound Through Touch . CHI Extended Abstracts on Human Factors in Computing Systems (2016), 2425--2430.
3. Brent Gillespie, Alex Russomanno, Mark Burns, and Sile O'Modhrain. 2016. The Holy Braille: A Tablet For The Visually Impaired . Popular Science May/June issue (2016).
4. Hiroshi Ishii and Brygg Ullmer. 1997. Tangible bits. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '97. 234--241.
5. Sergi Jordà , Gü nter Geiger, Marcos Alonso, and Martin Kaltenbrunner. 2007. The reacTable : Exploring the Synergy between Live Music Performance and Tabletop Tangible Interfaces. In Proceedings of Conference on Tangible and Embedded Interaction TEI '07. 139--146.
6. Martin Kaltenbrunner and Jens Vetter. 2018. Tquencer : A Tangible Musical Sequencer Using Overlays. In TEI 2018. 429--434.
7. Aaron Karp. 2017. HaptEQ : A Collaborative Tool For Visually Impaired Audio Producers. In the 12th International Audio Mostly Conference. ACM Press, New York, USA, 1--4.
8. Sile O'Modhrain and R. Brent Gillespie. 2018. Once More, with Feeling: Revisiting the Role of Touch in Performer-Instrument Interaction . In Musical Haptics. Chapter 2, 11--27.
9. Ivan Poupyrev, Tatsushi Nashida, Shigeaki Maruyama, Jun Rekimoto, and Yasufumi Yamaji. 2004. Lumen: interactive visual and shape display for calm computing . SIGGRAPH '04: SIGGRAPH 2004 Emerging technologies (2004), 17.
10. Atau Tanaka and Adam Parkinson. 2016. Haptic Wave. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. 2150--2161.

Index Terms

• Hardware

  • Communication hardware, interfaces and storage

    • Tactile and hand-based interfaces

      • Haptic devices

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Haptic devices

    • Interaction paradigms

      • Natural language interfaces

    • Interactive systems and tools

      • User interface toolkits

  • Interaction design

    • Interaction design process and methods

      • User centered design