Vocktail: A Virtual Cocktail for Pairing Digital Taste, Smell, and Color Sensations

ABSTRACT

Similar to the concept of a cocktail or mocktail, we present Vocktail (a.k.a. Virtual Cocktail) - an interactive drinking utensil that digitally simulates multisensory flavor experiences. The Vocktail system utilizes three common sensory modalities, taste, smell, and visual (color), to create virtual flavors and augment the existing flavors of a beverage. The system is coupled with a mobile application that enables users to create customized virtual flavor sensations by configuring each of the stimuli via Bluetooth. The system consists of a cocktail glass that is seamlessly fused into a 3D printed structure, which holds the electronic control module, three scent cartridges, and three micro air-pumps. When a user drinks from the system, the visual (RGB light projected on the beverage), taste (electrical stimulation at the tip of the tongue), and smell stimuli (emitted by micro air-pumps) are combined to create a virtual flavor sensation, thus altering the flavor of the beverage. In summary, this paper discusses 1) technical details of the Vocktail system and 2) user experiments that investigate the influences of these multimodal stimuli on the perception of virtual flavors in terms of five primary tastes (i.e. salty, sweet, bitter, sour, and umami). Our results suggest that the combination of these stimuli delivers richer flavor experiences, as compared to separately simulating individual modalities, and indicates that the types of pairings that can be formed between smell and electric taste stimuli.

References

1. Yong-Yeol Ahn, Sebastian E Ahnert, James P Bagrow, and Albert-László Barabási. 2011. Flavor network and the principles of food pairing. Scientific reports Vol. 1 (2011), 196--EP.
2. Paul AS Breslin. 2013. An evolutionary perspective on food and human taste. Current Biology, Vol. 23, 9 (2013), R409--R418.
3. Cynthia N DuBose, Armand V Cardello, and Owen Maller. 1980. Effects of Colorants and Flavorants on Identification, Perceived Flavor Intensity, and Hedonic Quality of Fruit-Flavored Beverages and Cake. Journal of Food Science Vol. 45, 5 (1980), 1393--1399.
4. Yuki Hashimoto, Naohisa Nagaya, Minoru Kojima, Satoru Miyajima, Junichiro Ohtaki, Akio Yamamoto, Tomoyasu Mitani, and Masahiko Inami. 2006. Straw-like user interface: virtual experience of the sensation of drinking using a straw Proceedings of the international conference on Advances in computer entertainment technology. ACM, 50.
5. Morton L Heilig. 1962. Sensorama simulator. (Aug. 28. 1962). US Patent 3,050,870.
6. Christopher Koch and Eric C Koch. 2003. Preconceptions of taste based on color. The Journal of Psychology Vol. 137, 3 (2003), 233--242.
7. I. Lackovic and Z. Stare. 2007. Low-frequency dielectric properties of the oral mucosa 13th International Conference on Electrical Bioimpedance and the 8th Conference on Electrical Impedance Tomography. Springer, 154--157.
8. Haruka Matsukura, Tatsuhiro Yoneda, and Hiroshi Ishida. 2013. Smelling Screen: Development and Evaluation of an Olfactory Display System for Presenting a Virtual Odor Source. Visualization and Computer Graphics, IEEE Transactions on, Vol. 19, 4 (2013), 606--615.
9. Dan Maynes-Aminzade. 2005. Edible bits: Seamless interfaces between people, data and food ACM CHI 2005 Extended Abstracts. Citeseer, 2207--2210.
10. Hiromi Nakamura and Homei Miyashita. 2011. Augmented gustation using electricity. In Proceedings of the 2nd Augmented Human International Conference. ACM, 34.
11. Hiromi Nakamura and Homei Miyashita. 2012. Development and evaluation of interactive system for synchronizing electric taste and visual content. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 517--520.
12. Takuji Narumi, Munehiko Sato, Tomohiro Tanikawa, and Michitaka Hirose. 2010. Evaluating cross-sensory perception of superimposing virtual color onto real drink: toward realization of pseudo-gustatory displays Proceedings of the 1st Augmented Human International Conference. ACM, 18.
13. Marianna Obrist, Alexandre N Tuch, and Kasper Hornbaek. 2014. Opportunities for odor: experiences with smell and implications for technology Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 2843--2852.
14. Nimesha Ranasinghe, Adrian David Cheok, and Ryohei Nakatsu. 2012. Taste/IP: the sensation of taste for digital communication Proceedings of the 14th ACM international conference on Multimodal interaction. ACM, 409--416.
15. Nimesha Ranasinghe and Ellen Yi-Luen Do. 2016. Digital Lollipop: Studying Electrical Stimulation on the Human Tongue to Simulate Taste Sensations. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 13, 1 (2016), 5.
16. Nimesha Ranasinghe, Pravar Jain, Shienny Karwita, and Ellen Yi-Luen Do. 2017. Virtual Lemonade: Let's Teleport Your Lemonade!. Proceedings of the Tenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 183--190.
17. Nimesha Ranasinghe, Kuan-Yi Lee, and Ellen Yi-Luen Do. 2014 a. FunRasa: an interactive drinking platform. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction. ACM, 133--136.
18. Nimesha Ranasinghe, Kuan-Yi Lee, Gajan Suthokumar, and Ellen Yi-Luen Do. 2014 b. Taste : digitally enhancing taste sensations of food and beverages Proceedings of the 22nd ACM international conference on Multimedia. ACM, 737--738.
19. Nimesha Ranasinghe, Kuan-Yi Lee, Gajan Suthokumar, and Ellen Yi-Luen Do. 2016. Virtual ingredients for food and beverages to create immersive taste experiences. Multimedia Tools and Applications Vol. 74, 24 (2016), 1--19.
20. Nimesha Ranasinghe, Ryohei Nakatsu, Hideaki Nii, and Ponnampalam Gopalakrishnakone. 2012. Tongue Mounted Interface for Digitally Actuating the Sense of Taste Wearable Computers (ISWC), 2012 16th International Symposium on. IEEE, 80--87.
21. Hendrik NJ Schifferstein and Peeter WJ Verlegh. 1996. The role of congruency and pleasantness in odor-induced taste enhancement. Acta psychologica, Vol. 94, 1 (1996), 87--105.
22. Marcia Simmons. 2011. DIY Cocktails: A simple guide to creating your own signature drinks. Simon and Schuster.
23. Charles Spence, Carmel A Levitan, Maya U Shankar, and Massimiliano Zampini. 2010. Does food color influence taste and flavor perception in humans? Chemosensory Perception Vol. 3, 1 (2010), 68--84.
24. Charles Spence, Xiaoang Wan, Andy Woods, Carlos Velasco, Jialin Deng, Jozef Youssef, and Ophelia Deroy. 2015. On tasty colours and colourful tastes? Assessing, explaining, and utilizing crossmodal correspondences between colours and basic tastes. Flavour, Vol. 4, 1 (2015), 1.
25. Charles Spence and Jozef Youssef. 2015. Olfactory dining: designing for the dominant sense. Flavour, Vol. 4, 1 (2015), 32.
26. Jennifer A Stillman. 1993. Color Influences Flavor Identification in Fruit-flavored Beverages. Journal of Food Science Vol. 58, 4 (1993), 810--812.
27. Chie Suzuki, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2014. Affecting tumbler: affecting our flavor perception with thermal feedback Proceedings of the 11th Conference on Advances in Computer Entertainment Technology. ACM, 19.
28. Luisa Torri and Silvia Salini. 2016. An itinerant sensory approach to investigate consumers' perception and acceptability at a food exhibition. Food Research International Vol. 90 (2016), 91--99.
29. Massimiliano Zampini, Emma Wantling, Nicola Phillips, and Charles Spence. 2008. Multisensory flavor perception: Assessing the influence of fruit acids and color cues on the perception of fruit-flavored beverages. Food quality and preference Vol. 19, 3 (2008), 335--343.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction paradigms

      • Mixed / augmented reality