Hayley Hung
ABSTRACT
In this paper, we estimate different types of social actions from a single body-worn accelerometer in a crowded social setting. Accelerometers have many advantages in such settings: they are impervious to environmental noise, unobtrusive, cheap, low-powered, and their readings are specific to a single person. Our experiments show that they are surprisingly informative of different types of social actions. The social actions we address in this paper are whether a person is speaking, laughing, gesturing, drinking, or stepping. To our knowledge, this is the first work to carry out experiments on estimating social actions from conversational behavior using only a wearable accelerometer. The ability to estimate such actions using just the acceleration opens up the potential for analyzing more about social aspects of people's interactions without explicitly recording what they are saying.
- L. Bao and S. Intille. Activity recognition from user-annotated acceleration data. Pervasive Computing, pages 1--17, 2004.Google Scholar
Cross Ref
- C. Cattuto, W. Van den Broeck, A. Barrat, V. Colizza, J. Pinton, and A. Vespignani. Dynamics of Person-to-Person Interactions from Distributed RFID Sensor Networks. PLOS ONE, 5(7):e11596, 07 2010.Google ScholarCross Ref
- T. L. Chartrand and J. A. Bargh. The chameleon effect: the perception-behavior link and social interaction. Journal of Personality and Social Psychology, 76(6):893--910, 1999.Google ScholarCross Ref
- C. Doukas, I. Maglogiannis, P. Tragas, D. Liapis, and G. Yovanof. Patient fall detection using support vector machines. Artificial Intelligence and Innovations 2007: from Theory to Applications, pages 147--156, 2007.Google Scholar
- H. Hung and D. Gatica-Perez. Estimating cohesion in small groups using audio-visual nonverbal behavior. Multimedia, IEEE Transactions on, 12(6):563--575, 2010. Google ScholarDigital Library
- D. Jayagopi, H. Hung, C. Yeo, and D. Gatica-Perez. Modeling dominance in group conversations from non-verbal activity cues. IEEE Transactions on Audio, Speech and Language Processing, 2008. Google ScholarDigital Library
- A. Kendon. Movement coordination in social interaction: Some examples described. Acta Psychologica, 32:101--125, 1970.Google ScholarCross Ref
- A. Kendon. Conducting Interaction: Patterns of Behavior in Focused Encounters. Cambridge University Press, 1990.Google Scholar
- J. R. Kwapisz, G. M. Weiss, and S. A. Moore. Activity recognition using cell phone accelerometers. ACM SIGKDD Explorations Newsletter, 12(2):74--82, 2011. Google ScholarDigital Library
- B. Lepri, J. Staiano, G. Rigato, K. Kalimeri, A. Finnerty, F. Pianesi, N. Sebe, and A. Pentland. The SocioMetric Badges Corpus: A Multilevel Behavioral Dataset for Social Behavior in Complex Organizations. In SocialCom/PASSAT, pages 623--628. IEEE, 2012. Google ScholarDigital Library
- M. S. Mast. Dominance as Expressed and Inferred Through Speaking Time. Human Communication Research, (3):420--450, July 2002.Google Scholar
- D. McNeill. Language and Gesture. Cambridge University Press New York, 2000.Google ScholarCross Ref
- D. O. Olguin, B. N. Waber, T. Kim, A. Mohan, K. Ara, and A. Pentland. Sensible Organizations: Technology and Methodology for Automatically Measuring Organizational Behavior. IEEE Transactions on Systems, Man, and Cybernetics, Part B, 39(1), 2009. Google ScholarDigital Library
- K. O'Quin and J. Aronoff. Humor as a Technique of Social Influence. Social Psychology Quarterly, 44(4):349--357, Dec. 1981.Google ScholarCross Ref
- S. Reddy, M. Mun, J. Burke, D. Estrin, M. Hansen, and M. Srivastava. Using mobile phones to determine transportation modes. ACM Transactions on Sensor Networks (TOSN), 6(2):13, 2010. Google ScholarDigital Library
- E. J. Romero and K. W. Cruthirds. The Use of Humor in the Workplace. Academy of Management Perspectives, 20(2):58--69, 2006.Google ScholarCross Ref
- D. Wyatt, T. Choudhury, J. Bilmes, and J. A. Kitts. Inferring colocation and conversation networks from privacy-sensitive audio with implications for computational social science. ACM Trans. Intell. Syst. Technol., 2(1):7:1--7:41, Jan. 2011. Google ScholarDigital Library
- T. Zhang, J. Wang, P. Liu, and J. Hou. Fall detection by embedding an accelerometer in cellphone and using KFD algorithm. International Journal of Computer Science and Network Security, 6(10):277--284, 2006.Google Scholar
Index Terms
- Classifying social actions with a single accelerometer
Recommendations
Detecting conversing groups with a single worn accelerometer
ICMI '14: Proceedings of the 16th International Conference on Multimodal InteractionIn this paper we propose the novel task of detecting groups of conversing people using only a single body-worn accelerometer per person. Our approach estimates each individual's social actions and uses the co-ordination of these social actions between ...
Systematic evaluation of social behaviour modelling with a single accelerometer
UbiComp '13 Adjunct: Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publicationWe describe our ongoing research on systematically analysing what types of socially related attributes and behaviours can be estimated automatically in highly social and crowded situations. This is a challenging task because obtaining the true labels ...
Mining for motivation: using a single wearable accelerometer to detect people's interests
IMMPD '12: Proceedings of the 2nd ACM international workshop on Interactive multimedia on mobile and portable devicesThis paper presents a novel investigation of how motion as measured with just a single wearable accelerometer is informative of people's interests and motivation during crowded social events. We collected accelerometer readings on a large number of ...
Comments