ABSTRACT
Similar to the concept of a cocktail or mocktail, we present Vocktail (a.k.a. Virtual Cocktail) - an interactive drinking utensil that digitally simulates multisensory flavor experiences. The Vocktail system utilizes three common sensory modalities, taste, smell, and visual (color), to create virtual flavors and augment the existing flavors of a beverage. The system is coupled with a mobile application that enables users to create customized virtual flavor sensations by configuring each of the stimuli via Bluetooth. The system consists of a cocktail glass that is seamlessly fused into a 3D printed structure, which holds the electronic control module, three scent cartridges, and three micro air-pumps. When a user drinks from the system, the visual (RGB light projected on the beverage), taste (electrical stimulation at the tip of the tongue), and smell stimuli (emitted by micro air-pumps) are combined to create a virtual flavor sensation, thus altering the flavor of the beverage. In summary, this paper discusses 1) technical details of the Vocktail system and 2) user experiments that investigate the influences of these multimodal stimuli on the perception of virtual flavors in terms of five primary tastes (i.e. salty, sweet, bitter, sour, and umami). Our results suggest that the combination of these stimuli delivers richer flavor experiences, as compared to separately simulating individual modalities, and indicates that the types of pairings that can be formed between smell and electric taste stimuli.
- Yong-Yeol Ahn, Sebastian E Ahnert, James P Bagrow, and Albert-László Barabási. 2011. Flavor network and the principles of food pairing. Scientific reports Vol. 1 (2011), 196--EP.Google Scholar
- Paul AS Breslin. 2013. An evolutionary perspective on food and human taste. Current Biology, Vol. 23, 9 (2013), R409--R418.Google ScholarCross Ref
- Cynthia N DuBose, Armand V Cardello, and Owen Maller. 1980. Effects of Colorants and Flavorants on Identification, Perceived Flavor Intensity, and Hedonic Quality of Fruit-Flavored Beverages and Cake. Journal of Food Science Vol. 45, 5 (1980), 1393--1399.Google ScholarCross Ref
- Yuki Hashimoto, Naohisa Nagaya, Minoru Kojima, Satoru Miyajima, Junichiro Ohtaki, Akio Yamamoto, Tomoyasu Mitani, and Masahiko Inami. 2006. Straw-like user interface: virtual experience of the sensation of drinking using a straw Proceedings of the international conference on Advances in computer entertainment technology. ACM, 50. Google ScholarDigital Library
- Morton L Heilig. 1962. Sensorama simulator. (Aug. 28. 1962). US Patent 3,050,870.Google Scholar
- Christopher Koch and Eric C Koch. 2003. Preconceptions of taste based on color. The Journal of Psychology Vol. 137, 3 (2003), 233--242.Google ScholarCross Ref
- I. Lackovic and Z. Stare. 2007. Low-frequency dielectric properties of the oral mucosa 13th International Conference on Electrical Bioimpedance and the 8th Conference on Electrical Impedance Tomography. Springer, 154--157.Google Scholar
- Haruka Matsukura, Tatsuhiro Yoneda, and Hiroshi Ishida. 2013. Smelling Screen: Development and Evaluation of an Olfactory Display System for Presenting a Virtual Odor Source. Visualization and Computer Graphics, IEEE Transactions on, Vol. 19, 4 (2013), 606--615. Google ScholarDigital Library
- Dan Maynes-Aminzade. 2005. Edible bits: Seamless interfaces between people, data and food ACM CHI 2005 Extended Abstracts. Citeseer, 2207--2210.Google Scholar
- Hiromi Nakamura and Homei Miyashita. 2011. Augmented gustation using electricity. In Proceedings of the 2nd Augmented Human International Conference. ACM, 34. Google ScholarDigital Library
- Hiromi Nakamura and Homei Miyashita. 2012. Development and evaluation of interactive system for synchronizing electric taste and visual content. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 517--520. Google ScholarDigital Library
- Takuji Narumi, Munehiko Sato, Tomohiro Tanikawa, and Michitaka Hirose. 2010. Evaluating cross-sensory perception of superimposing virtual color onto real drink: toward realization of pseudo-gustatory displays Proceedings of the 1st Augmented Human International Conference. ACM, 18. Google ScholarDigital Library
- Marianna Obrist, Alexandre N Tuch, and Kasper Hornbaek. 2014. Opportunities for odor: experiences with smell and implications for technology Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 2843--2852. Google ScholarDigital Library
- Nimesha Ranasinghe, Adrian David Cheok, and Ryohei Nakatsu. 2012. Taste/IP: the sensation of taste for digital communication Proceedings of the 14th ACM international conference on Multimodal interaction. ACM, 409--416. Google ScholarDigital Library
- Nimesha Ranasinghe and Ellen Yi-Luen Do. 2016. Digital Lollipop: Studying Electrical Stimulation on the Human Tongue to Simulate Taste Sensations. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 13, 1 (2016), 5. Google ScholarDigital Library
- Nimesha Ranasinghe, Pravar Jain, Shienny Karwita, and Ellen Yi-Luen Do. 2017. Virtual Lemonade: Let's Teleport Your Lemonade!. Proceedings of the Tenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 183--190. Google ScholarDigital Library
- Nimesha Ranasinghe, Kuan-Yi Lee, and Ellen Yi-Luen Do. 2014 a. FunRasa: an interactive drinking platform. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction. ACM, 133--136. Google ScholarDigital Library
- Nimesha Ranasinghe, Kuan-Yi Lee, Gajan Suthokumar, and Ellen Yi-Luen Do. 2014 b. Taste : digitally enhancing taste sensations of food and beverages Proceedings of the 22nd ACM international conference on Multimedia. ACM, 737--738. Google ScholarDigital Library
- Nimesha Ranasinghe, Kuan-Yi Lee, Gajan Suthokumar, and Ellen Yi-Luen Do. 2016. Virtual ingredients for food and beverages to create immersive taste experiences. Multimedia Tools and Applications Vol. 74, 24 (2016), 1--19. Google ScholarDigital Library
- Nimesha Ranasinghe, Ryohei Nakatsu, Hideaki Nii, and Ponnampalam Gopalakrishnakone. 2012. Tongue Mounted Interface for Digitally Actuating the Sense of Taste Wearable Computers (ISWC), 2012 16th International Symposium on. IEEE, 80--87. Google ScholarDigital Library
- Hendrik NJ Schifferstein and Peeter WJ Verlegh. 1996. The role of congruency and pleasantness in odor-induced taste enhancement. Acta psychologica, Vol. 94, 1 (1996), 87--105.Google Scholar
- Marcia Simmons. 2011. DIY Cocktails: A simple guide to creating your own signature drinks. Simon and Schuster.Google Scholar
- Charles Spence, Carmel A Levitan, Maya U Shankar, and Massimiliano Zampini. 2010. Does food color influence taste and flavor perception in humans? Chemosensory Perception Vol. 3, 1 (2010), 68--84.Google ScholarCross Ref
- Charles Spence, Xiaoang Wan, Andy Woods, Carlos Velasco, Jialin Deng, Jozef Youssef, and Ophelia Deroy. 2015. On tasty colours and colourful tastes? Assessing, explaining, and utilizing crossmodal correspondences between colours and basic tastes. Flavour, Vol. 4, 1 (2015), 1.Google ScholarCross Ref
- Charles Spence and Jozef Youssef. 2015. Olfactory dining: designing for the dominant sense. Flavour, Vol. 4, 1 (2015), 32.Google ScholarCross Ref
- Jennifer A Stillman. 1993. Color Influences Flavor Identification in Fruit-flavored Beverages. Journal of Food Science Vol. 58, 4 (1993), 810--812.Google ScholarCross Ref
- Chie Suzuki, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2014. Affecting tumbler: affecting our flavor perception with thermal feedback Proceedings of the 11th Conference on Advances in Computer Entertainment Technology. ACM, 19. Google ScholarDigital Library
- Luisa Torri and Silvia Salini. 2016. An itinerant sensory approach to investigate consumers' perception and acceptability at a food exhibition. Food Research International Vol. 90 (2016), 91--99.Google ScholarCross Ref
- Massimiliano Zampini, Emma Wantling, Nicola Phillips, and Charles Spence. 2008. Multisensory flavor perception: Assessing the influence of fruit acids and color cues on the perception of fruit-flavored beverages. Food quality and preference Vol. 19, 3 (2008), 335--343.Google Scholar
Index Terms
- Vocktail: A Virtual Cocktail for Pairing Digital Taste, Smell, and Color Sensations
Recommendations
Augmented gustation using electricity
AH '11: Proceedings of the 2nd Augmented Human International ConferenceIn this paper, we propose a method to augment gustation and increase the number of perceptible tastes. Electric taste is the sensation elicited upon stimulating the tongue with electric current. We used this phenomenon to convey information that humans ...
The Sensation of Taste in the Future of Immersive Media
ImmersiveMe '14: Proceedings of the 2nd ACM International Workshop on Immersive Media ExperiencesTo create a truly immersive virtual experience, perceiving information through multiple human senses is important. Therefore, new forms of media are required that deeply involve various human senses -not only sight, sound, and touch, but also ...
Controlling Temporal Change of a Beverage's Taste Using Electrical Stimulation
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing SystemsIn this paper, we discuss concepts for improving beverage experience using electrical stimulation in terms of the requirements for the procedure (design space), previous study (completion), and limitations of conventional technologies. To improve ...
Comments