skip to main content
10.1145/2517351.2517368acmconferencesArticle/Chapter ViewAbstractPublication PagessensysConference Proceedingsconference-collections
research-article

Lifestreams: a modular sense-making toolset for identifying important patterns from everyday life

Published:11 November 2013Publication History

ABSTRACT

Smartphones can capture diverse spatio-temporal data about an individual; including both intermittent self-report, and continuous passive data collection from onboard sensors and applications. The resulting personal data streams can support powerful inference about the user's state, behavior, well-being and environment. However making sense and acting on these multi-dimensional, heterogeneous data streams requires iterative and intensive exploration of the datasets, and development of customized analysis techniques that are appropriate for a particular health domain.

Lifestreams is a modular and extensible open-source data analysis stack designed to facilitate the exploration and evaluation of personal data stream sense-making. Lifestreams analysis modules include: feature extraction from raw data; feature selection; pattern and trend inference; and interactive visualization. The system was iteratively designed during a 6-month pilot in which 44 young mothers used an open-source participatory mHealth platform to record both self-report and passive data about their diet, stress and exercise. Feedback as participants and the study coordinator attempted to use the Lifestreams dashboard to make sense of their data collected during this intensive study were critical inputs into the design process. In order to explore the generality and extensibility of Lifestreams pipeline, it was then applied to two additional studies with different datasets, including a continuous stream of audio data, self-report data, and mobile system analytics. In all three studies, Lifestreams' integrated analysis pipeline was able to identify key behaviors and trends in the data that were not otherwise identified by participants.

References

  1. The free dictionary: Inference. http://www.thefreedictionary.com/inference.Google ScholarGoogle Scholar
  2. Ginger.io - http://ginger.io/.Google ScholarGoogle Scholar
  3. N. Aaron. A data-rich approach for investigating social mechanisms in the wild. In Ubicomp'11.Google ScholarGoogle Scholar
  4. D. Ashbrook and T. Starner. Using gps to learn significant locations and predict movement across multiple users. Personal and Ubiquitous Computing, 7(5):275--286, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. L. Bao and S. S. Intille. Activity recognition from user-annotated acceleration data. Lecture Notes in Computer Science, pages 1--17, 2004.Google ScholarGoogle Scholar
  6. M Basseville and IV Nikiforov. Detection of abrupt changes: theory and application. Prentice Hall Englewood Cliffs, NJ, 1993. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. N. M. Bradburn. Temporal representation and event dating. The science of self-report: Implications for research and practice, pages 49--61, 2000.Google ScholarGoogle Scholar
  8. P. J. Brockwell. Time Series Analysis. John Wiley Sons, Ltd, 2005.Google ScholarGoogle ScholarCross RefCross Ref
  9. C. Zhou, D. Frankowski, P. Ludford, S. Shekhar, and L. Terveen. Discovering personal gazetteers: an interactive clustering approach. In Proceedings of the 12th annual ACM international workshop on Geographic information systems. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. S. Consolvo, D. W. McDonald, T. Toscos, M. Y. Chen, J. Froehlich, B. Harrison, P. Klasnja, A. LaMarca, L. LeGrand, R. Libby, et al. Activity sensing in the wild: a field trial of ubifit garden. SIGCHI'08. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. M. L. Dansinger, J. A. Gleason, J. L. Griffith, H. P. Selker, and E. J. Schaefer. Comparison of the atkins, ornish, weight watchers, and zone diets for weight loss and heart disease risk reduction. JAMA: the journal of the American Medical Association, 293(1):43--53, 2005.Google ScholarGoogle Scholar
  12. D. M. Donovan and G. A. Marlatt. Assessment of addictive behaviors. Guilford Press, 2005.Google ScholarGoogle Scholar
  13. N. Eagle and A. Pentland. Reality mining: sensing complex social systems. Personal and Ubiquitous Computing, 10(4):255--268, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. N. Eagle and A. S. Pentland. Eigenbehaviors: Identifying structure in routine. Behavioral Ecology and Sociobiology, 63(7):1057--10, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  15. M. Ester, H. P. Kriegel, J. Sander, and X. Xu. A density-based algorithm for discovering clusters in large spatial databases with noise. KDD'96.Google ScholarGoogle Scholar
  16. D. Estrin and I. Sim. Open mhealth architecture: an engine for health care innovation. Science, 330(6005):759--760, 2010.Google ScholarGoogle ScholarCross RefCross Ref
  17. H. Falaki, R. Mahajan, and D. Estrin. Systemsens: a tool for monitoring usage in smartphone research deployments. In MobiArch'11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Bailey, Rosemary A. Design of comparative experiments. Vol. 25. Cambridge University Press, 2008.Google ScholarGoogle Scholar
  19. T. Fu, F. Chung, V. Ng, and R. Luk. Evolutionary segmentation of financial time series into subsequences. Evolutionary Computation, 2001, 1:426--430, 2001.Google ScholarGoogle Scholar
  20. J. Hightower, S. Consolvo, A. LaMarca, I. Smith, and J. Hughes. Learning and recognizing the places we go. UbiComp'05. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. M. R. Hufford. Special methodological challenges and opportunities in ecological momentary assessment. The science of real-time data capture: Self-reports in health research, pages 54--75, 2007.Google ScholarGoogle Scholar
  22. D. H. Kim, J. Hightower, R. Govindan, and D. Estrin. Discovering semantically meaningful places from pervasive rf-beacons. In Ubicomp'09. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. P. Klasnja and W. Pratt. Healthcare in the pocket: Mapping the space of mobile-phone health interventions. Journal of Biomedical Informatics, 45(1):184--198, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. T. L. Lai. Sequential changepoint detection in quality control and dynamical systems. Journal of the Royal Statistical Society, 57(4):613--658, 1995.Google ScholarGoogle Scholar
  25. A. LaMarca, et al. Place lab: Device positioning using radio beacons in the wild. Pervasive Computing, pages 301--306, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. N. D. Lane, M. Mohammod, M. Lin, X. Yang, H. Lu, S. Ali, A. Doryab, E. Berke, T. Choudhury, and A. T. Campbell. Bewell: A smartphone application to monitor, model and promote wellbeing. In PervasiveHealth'11.Google ScholarGoogle Scholar
  27. L. Liao, D. Fox, and H. Kautz. Extracting places and activities from gps traces using hierarchical conditional random fields. The International Journal of Robotics Research, 26(1):119--134, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. R. LiKamWa, Y. Liu, N. D. Lane, and L. Zhong. Can your smartphone infer your mood. In PhoneSense'11.Google ScholarGoogle Scholar
  29. G. A. Marlatt. Relapse prevention: Theoretical rationale and overview of the model. Relapse prevention: Maintenance strategies in the treatment of addictive behaviors, pages 3--70, 1985.Google ScholarGoogle Scholar
  30. H. Peng, F. Long, and C. Ding. Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Cohen, Jack. Statistical power analysis for the behavioral sciences. Routledge Academic, 1988.Google ScholarGoogle Scholar
  32. S. Reddy, J. Burke, D. Estrin, M. Hansen, and M. Srivastava. Determining transportation mode on mobile phones. In Proceedings of The 12th IEEE Int. Symposium on Wearable Computers, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Gordon J. Ross. cpm: Sequential Parametric and Nonparametric Change Detection, 2012.Google ScholarGoogle Scholar
  34. J. Ryder, B. Longstaff, S. Reddy, and D. Estrin. Ambulation: a tool for monitoring mobility patterns over time using mobile phones. In 2009 International Conference on Computational Science and Engineering, pages 927--931, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. T. Saponas, J. Lester, J. Froehlich, J. Fogarty, and J. Landay. iLearn on the iPhone: Real-time human activity classification on commodity mobile phones. University of Washington CSE Tech Report UW-CSE-08-04-02, 2008.Google ScholarGoogle Scholar
  36. N. Schwarz. Retrospective and concurrent self-reports: The rationale for real-time data capture. The science of real-time data capture: Self-reports in health research, pages 11--26, 2007.Google ScholarGoogle Scholar
  37. D. Wied and P. Galeano. Monitoring correlation change in a sequence of random variables. Journal of Statistical Planning and Inference, 143:186--196, 2013.Google ScholarGoogle ScholarCross RefCross Ref
  38. C. Zhou, C. Zou, Y Zhang, and Z Wang. Nonparametric control chart based on change-point model. Statistical Papers, 50(1):13--28, March 2007.Google ScholarGoogle ScholarCross RefCross Ref
  39. R. Fenwick, and M. Tausig. Scheduling stress family and health outcomes of shift work and schedule control. American Behavioral Scientist 44.7 (2001): 1179--1198.Google ScholarGoogle ScholarCross RefCross Ref
  40. H., Donald, Generalized linear mixed models. Encyclopedia of statistics in behavioral science, 2005.Google ScholarGoogle Scholar
  41. lme4 - Mixed-effects models project. http://lme4.r-forge.r-project.org/.Google ScholarGoogle Scholar
  42. Fitbit - http://www.fitbit.com/.Google ScholarGoogle Scholar
  43. B. Longstaff, S. Reddy, D. Estrin. Improving activity classification for health applications on mobile devices using active and semi-supervised learning, PervasiveHealth, 2010.Google ScholarGoogle ScholarCross RefCross Ref
  44. Passive PRO - http://c3nproject.org/innovations/patient-self-tracking-continuous-care/passive-proGoogle ScholarGoogle Scholar
  45. Mobile App: PTSD Coach. National Center for PTSD - http://www.ptsd.va.gov/public/pages/ptsdcoach.aspGoogle ScholarGoogle Scholar
  46. C. C. Quinn, S. S. Clough, J. M. Minor, D. Lender, M. C. Okafor, and A. Gruber-Baldini. WellDoc mobile diabetes management randomized controlled trial: Change in clinical and behavioral outcomes and patient and physician satisfaction. Diabetes Technology and Therapeutics, 10(3):160--168, 2008Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Lifestreams: a modular sense-making toolset for identifying important patterns from everyday life

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        SenSys '13: Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems
        November 2013
        443 pages
        ISBN:9781450320276
        DOI:10.1145/2517351

        Copyright © 2013 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 11 November 2013

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        SenSys '13 Paper Acceptance Rate21of123submissions,17%Overall Acceptance Rate174of867submissions,20%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader