Eyal Dim
Tsvi Kuflik
Skip Abstract Section
Abstract
In many cases, visitors come to a museum in small groups. In such cases, the visitors’ social context has an impact on their museum visit experience. Knowing the social context may allow a system to provide socially aware services to the visitors. Evidence of the social context can be gained from observing/monitoring the visitors’ social behavior. However, automatic identification of a social context requires, on the one hand, identifying typical social behavior patterns and, on the other, using relevant sensors that measure various signals and reason about them to detect the visitors’ social behavior. We present such typical social behavior patterns of visitor pairs, identified by observations, and then the instrumentation, detection process, reasoning, and analysis of measured signals that enable us to detect the visitors’ social behavior. Simple sensors’ data, such as proximity to other visitors, proximity to museum points of interest, and visitor orientation are used to detect social synchronization, attention to the social companion, and interest in museum exhibits. The presented approach may allow future research to offer adaptive services to museum visitors based on their social context to support their group visit experience better.
- C. C. Aggarwal and T. Abdelzaher. 2013. Social sensing. In Managing and Mining Sensor Data. Springer, 237--297.Google Scholar
- P. M. Aoki, R. E. Grinter, A. Hurst, M. H. Szymanski, J. D. Thornton, and A. Woodruff. 2002. Sotto voce: Exploring the interplay of conversation and mobile audio spaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’02). ACM, New York, NY, 431--438. Google ScholarDigital Library
- K. Ara, N. Kanehira, O. D. Olguin, B. N. Waber, T. Kim, A. Mohan, P. Gloor, R. Laubacher, D. Oster, A. Pentland, and K. Yano. 2008. Sensible organizations: Changing our businesses and work styles through sensor data. Journal of Information Processing 16, 1--12.Google ScholarCross Ref
- L. Ardissono, T. Kuflik, and D. Petrelli. 2012. Personalization in cultural heritage: The road travelled and the one ahead. User Modeling and User Adapted Interaction 22, 1--2, 73--99. Google ScholarDigital Library
- P. Bell. 2009. Learning Science in Informal Environments: People, Places, and Pursuits. National Academies Press, Washington, DC.Google Scholar
- B. J. Biddle. 1986. Recent development in role theory. Annual Review of Sociology 12, 67--92.Google ScholarCross Ref
- S. Bitgood. 2002. Environmental psychology in museums, zoos, and other exhibition centers. In Bechtel, R. and Churchman, A. (Eds.), Handbook of Environmental Psychology. John Wiley & Sons, 461--480.Google Scholar
- P. Brusilovsky and E. Millan. 2007. User models for adaptive hypermedia and adaptive educational systems. In The Adaptive Web. Lecture Notes in Computer Science, Vol. 4321. Springer, 5--53. Google ScholarDigital Library
- C. Callaway, O. Stock, E. Dekoven, K. Noy, Y. Citron, and Y. Dobrin. 2012. Mobile drama in an instrumented museum: Inducing group conversation via coordinated narratives. New Review of Hypermedia and Multimedia 18, 1--2, 37--61. Google ScholarDigital Library
- G. Caridakis, J. Wagner, A. Raouzaiou, Z. Curto, E. André, and K. Karpouzis. 2010. A multimodal corpus for gesture expressivity analysis. In Proceedings of the Conference of Multimodal Corpora: Advances in Capturing, Coding, and Analyzing Multimodality. 17--23.Google Scholar
- J. Cohen. 1960. A coefficient of agreement for nominal scales. Educational and Psychological Measurements 20, 37--46.Google ScholarCross Ref
- M. Cook. 1970. Experiments on orientation and proxemics. Human Relations 23, 61--76.Google ScholarCross Ref
- M. Cristani, L. Bazzani, G. Paggetti, A. Fossati, D. Tosato, A. D. Bue, G. Menegaz, and V. Murino. 2011. Social interaction discovery by statistical analysis of F-formations. In Proceedings of the British Machine Vision Conference. 23.1--23.12.Google Scholar
- D. Dean. 1994. Museum Exhibition: Theory and Practice. Routledge, London, UK.Google ScholarCross Ref
- A. De Angelis, J. Nilsson, I. Skog, P. Händel, and P. Carbone. 2010. Indoor positioning by ultra wide band radio aided inertial navigation. Metrology and Measurement Systems 17, 3, 447--460.Google ScholarCross Ref
- K. Delac, M. Grgic, and M. S. Bartlett (Eds.). 2008. Recent Advances in Face Recognition. InTech, Rokela, Croatia.Google Scholar
- E. Dim and T. Kuflik. 2009. Group situational awareness: Being together. In Proceedings of the Workshop on Personalization at the International Conference on User Modeling and Adaptive Hypermedia (UMAP’09).Google Scholar
- T. M. T. Do and D. Gatica-Perez. 2011. GroupUs: Smartphone proximity data and human interaction type mining. In Proceedings of the 15th Annual International Symposium on Wearable Computers (ISWC’11). IEEE, Los Alamitos, CA, 21--28. Google ScholarDigital Library
- T. M. T. Do and D. Gatica-Perez. 2013. Human interaction discovery in smartphone proximity networks. Personal and Ubiquitous Computing 17, 3, 413--431. Google ScholarDigital Library
- M. Endler, A. Skyrme, D. Schuster, and T. Springer. 2011. Defining situated social context for pervasive social computing. In Proceedings of the 2nd IEEE Workshop on Pervasive Collaboration and Social Networking (PerCol’11). 519--524.Google Scholar
- J. H. Falk. 2009. Identity and the Museum Visitor Experience. Left Coast Press, Walnut Creek, CA.Google Scholar
- J. H. Falk and L. Dierking. 2000. Learning from Museums: Visitor Experiences and the Making of Meaning. AltaMira Press, Walnut Creek, CA.Google Scholar
- K. Farrahi, R. Emonet, and A. Ferscha. 2012. Socio-technical network analysis from wearable interactions. In Proceedings of the 6th International Symposium on Wearable Computers (ISWC’12). IEEE, Los Alamitos, CA, 9--16. Google ScholarDigital Library
- R. E. Grinter, P. M. Aoki, M. H. Szymanski, J. D. Thornton, A. Woodruff, and A. Hurst. 2002. Revisiting the visit: Understanding how technology can shape the museum visit. In Proceedings of the 2002 ACM Conference on Computer Supported Cooperative Work. ACM, New York, NY, 146--155. Google ScholarDigital Library
- C. Heath and D. Vom Lehn. 2008. Enhancing engagement in science centers and museums. Social Studies of Science 38, 1, 63--91.Google ScholarCross Ref
- E. Hooper-Greenhill. 1994. Museums and Their Visitors. Routledge, London.Google Scholar
- S. Hsi. 2003. A study of user experiences mediated by nomadic Web content in a museum. Journal of Computer Assisted Learning 19, 308--319.Google ScholarCross Ref
- H. Hung and B. Kröse. 2011. Detecting F-formations as dominant sets. In Proceedings of the 13th International Conference on Multimodal Interfaces. ACM, New York, NY, 231--238. Google ScholarDigital Library
- A. Jameson and B. Smyth. 2007. Recommendation to groups. In The Adaptive Web. Lecture Notes in Computer Science, Vol. 4321, Springer, 596--627. Google ScholarDigital Library
- J. Kay and W. Niu. 2005. Adapting information delivery to groups of people. In Proceedings of the UM Workshop on New Technologies for Personalized Information Access.Google Scholar
- A. Kendon. 1990. Conducting Interaction: Patterns of Behavior in Focused Encounters. Cambridge University Press, Cambridge, MA.Google Scholar
- M. Kenteris, D. Gavalas, and D. Economou. 2011. Electronic mobile guides: A survey. Personal and Ubiquitous Computing 15, 1, 97--111. Google ScholarDigital Library
- T. Kim, A. Chang, and A. Pentland. 2007. Enhancing organizational communication using sociometric badges. In Proceedings of the IEEE 11th International Symposium on Wearable Computing.Google Scholar
- M. B. Kjærgaard, H. Blunck, M. Wüstenberg, K. Grønbæk, M. Wirz, D. Roggen, and G. Tröster. 2013. Time-lag method for detecting following and leadership behavior of pedestrians from mobile sensing data. In Proceedings of the IEEE International Conference on Pervasive Computing and Communications (PerCom’13). 56--64.Google Scholar
- A. Kobsa and W. Wahlster. 1990. User Models in Dialog Systems. Springer-Verlag, New York, NY. Google ScholarDigital Library
- C. Kray and Y. Baus. 2003. A survey of mobile guides. In Proceedings of the Workshop on HCI in Mobile Guides in Conjunction with the 5th International Symposium on Human Computer Interaction with Mobile Devices and Services.Google Scholar
- T. Kuflik and E. Dim. 2013. Early detection of pairs of visitors by using a museum triage. In Proceedings of the Annual Conference of Museums and the Web.Google Scholar
- T. Kuflik, J. Lanir, E. Dim, A. Wecker, M. Corra, M. Zancanaro, and O. Stock. 2012. Indoor positioning in cultural heritage: Challenges and a solution. In Proceedings of the IEEE 27th Convention of Electrical and Electronics Engineers in Israel (IEEEI’12). IEEE, Los Alamitos, CA, 1--5.Google Scholar
- T. Kuflik, O. Stock, M. Zancanaro, A. Gorfinkel, S. Jbara, S. Kats, J. Sheidin, and N. Kashtan. 2011. A visitor's guide in an active museum: Presentations, communications, and reflection. Journal on Computing and Cultural Heritage 3, 3, 1--25. Google ScholarDigital Library
- H. Kuzuoka, Y. Suzuki, J. Yamashita, and K. Yamazaki. 2010. Reconfiguring spatial formation arrangement by robot body orientation. In Proceedings of the 5th ACM/IEEE International Conference on Human-Robot Interaction. 285--292. Google ScholarDigital Library
- J. Lanir, T. Kuflik, E. Dim, A. J. Wecker, and O. Stock. 2013. The influence of a location-aware mobile guide on museum visitors’ behavior. Interacting with Computers 25, 6, 443--460.Google ScholarCross Ref
- G. Leinhardt and K. Knutson. 2004. Listening In on Museum Conversations. AltaMira Press, Walnut Creek, CA.Google Scholar
- K. Luyten, H. van Loon, D. Teunkëns, K. Gabriëls, K. Coninx, and E. Manshoven. 2006. ARCHIE: Disclosing a museum by a socially-aware mobile guide. In Proceedings of the 7th International Symposium on Virtual Reality, Archaeology, and Cultural Heritage. 221--226.Google Scholar
- M. Mancas, D. Glowinski, P. Brunet, F. Cavallero, C. Machy, P. J. Maes, S. Paschalidou, M. K. Rajagopal, S. Schibeci, L. Vincze, and G. Volpe. 2009. Hypersocial museum: Addressing the social interaction challenge with museum scenarios and attention-based approaches. Quarterly Progress Scientific Report (QPSR) of the Numediart Research Program 2. 3, 91--96.Google Scholar
- N. Marquardt, K. Hinckley, and S. Greenberg. 2012. Cross-device interaction via micro-mobility and F-formations. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, 13--22. Google ScholarDigital Library
- P. Marshall, Y. Rogers, and N. Pantidi. 2011. Using F-formations to analyze spatial patterns of interaction in physical environments. In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work. 445--454. Google ScholarDigital Library
- A. Matic, V. Osmani, and O. Mayora-Ibarra. 2012. Analysis of social interactions through mobile phones. Mobile Networks and Applications 17, 6, 808--819.Google ScholarCross Ref
- P. McManus. 1991. Towards understanding the needs of museum visitors. In B. Lord and G. D. Lord (Eds.), Manual of Museum Planning. HMSO, London, UK, 35--51.Google Scholar
- I. Y. Nakano and R. Ishii. 2010. Estimating user's engagement from eye-gaze behaviors in human-agent conversations. In Proceedings of the 14th International Conference on Intelligent User Interfaces (IUI’10). 139--148. Google ScholarDigital Library
- A. Nijholt and D. Tan. 2008. Brain-computer interfacing for intelligent systems. IEEE Intelligent Systems 23, 3, 72--79. Google ScholarDigital Library
- S. Nishio, N. Hagita, T. Miyashita, T. Kanda, N. Mitsunaga, M. Shiomi, and T. Yamazaki. 2009. Sensor network for structuring people and environmental information. In Cutting Edge Robotics 2010. In-The, Vukovar, Croatia, 367--378.Google Scholar
- O. D. Olguin, B. N. Waber, T. Kim, A. Mohan, K. Ara, and A. Pentland. 2009. Sensible organizations: Technology and methodology for automatically measuring organizational behavior. IEEE Transactions on Systems, Man, and Cybernetics—Part B: Cybernetics 39, 1, 39--45. Google ScholarDigital Library
- J. Packer and R. Ballantyne. 2005. Solitary vs. shared: Exploring the social dimension of museum learning. Curator 48, 177--192.Google ScholarCross Ref
- A. Pentland and T. Heibeck. 2008. Honest Signals: How They Shape Our World. MIT Press, Cambridge, MA. Google ScholarCross Ref
- R. Sommer. 1965. Further studies in small group ecology. Sociometry 28, 337--348.Google ScholarCross Ref
- S. Sosnovsky and D. Dicheva. 2010. Ontological technologies for user modelling. International Journal of Metadata, Semantics, and Ontologies 5, 1, 32--71. Google ScholarDigital Library
- R. Stevens and S. Toro-Martell. 2003. Leaving a trace: Supporting museum visitor interaction and interpretation with digital media annotation systems. Journal of Museum Education 28, 2, 25--30.Google ScholarCross Ref
- O. Stock, M. Zancanaro, F. Pianesi, D. Tomasini, and C. Rocchi. 2009. Formative evaluation of a tabletop display meant to orient casual conversation. Journal of Knowledge, Technology and Policy 22, 1, 17--23.Google ScholarCross Ref
- Y. Sumi and K. Mase. 2004. Interface agents that facilitate knowledge interaction between community members. In Life-Like Characters. Cognitive Technologies 2004. Springer, 405--427.Google Scholar
- T. Toyama, T. Kieninger, F. Shafait, and A. Dengel. 2011. Museum guide 2.0—an eye-tracking based personal assistant for museums and exhibits. In Proceedings of the International Conference on Re-Thinking Technology in Museums.Google Scholar
- E. Veron and M. Levasseur. 1983. Ethographie de l’Exposition. In Paris, Bibliotheque Publique d’Information. Centre Georges Pompidou, 91--92.Google Scholar
- A. Vinciarelli, M. Pantic, D. Heylen, C. Pelachaud, I. Poggi, F. D’Errico, and M. Schroeder. 2012. Bridging the gap between social animal and unsocial machine: A survey of social signal processing. IEEE Transactions on Affective Computing 3, 1, 69--87. Google ScholarDigital Library
- D. Vom Lehn. 2006. Embodying experience: A video-based examination of visitors’ conduct and interaction in museums. European Journal of Marketing 40, 11--12, 1340--1359.Google ScholarCross Ref
- B. N. Waber, O. D. Olguin, T. Kim, A. Mohan, K. Ara, and A. Pentland. 2007. Organizational engineering using sociometric badges. In Proceedings of the International Conference on Network Science.Google Scholar
- A. J. Wecker, T. Kuflik, E. Dim, and J. Lanir 2013. Different reality modalities for museum navigation. In Proceedings of the Workshop on Location Awareness for Mixed and Dual Reality (LAMDa’13).Google Scholar
- F. Yamaoka, T. Kanda, H. Ishiguro, and N. Hagita. 2009. Developing a model of robot behavior to identify and appropriately respond to implicit attention-shifting. In Proceedings of the 4th ACM/IEEE International Conference on Human Robot Interaction. 133--140. Google ScholarDigital Library
Index Terms
- Automatic Detection of Social Behavior of Museum Visitor Pairs
Recommendations
Bridging social capital matters to Social TV viewing: Investigating the impact of social constructs on program loyalty
Highlights- A STV model examines relationships between social factors, program commitment and loyalty.
AbstractSocial TV (STV) that utilizes social media to create an interactive backchannel for video viewing increasingly attracts social audiences. This national web survey in Singapore was conducted to investigate 600 social media users with ...
The role of smartphone-based social media capabilities in building social capital, trust, and credibility to engage consumers in eWOM: a social presence theory perspective
Smartphone-based social media has established itself a key platform for users to cultivate intimate social connections and exchange brand-related information, regardless of time or location, such as eWOM. However, understanding the essential elements of ...
Leveraging social context for searching social media
SSM '08: Proceedings of the 2008 ACM workshop on Search in social mediaThe ability to utilize and benefit from today's explosion of social media sites depends on providing tools that allow users to productively participate. In order to participate, users must be able to find resources (both people and information) that ...
Comments