skip to main content
10.1145/3132847.3132981acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

Finding Periodic Discrete Events in Noisy Streams

Published:06 November 2017Publication History

ABSTRACT

Periodic phenomena are ubiquitous, but detecting and predicting periodic events can be difficult in noisy environments. We describe a model of periodic events that covers both idealized and realistic scenarios characterized by multiple kinds of noise. The model incorporates false-positive events and the possibility that the underlying period and phase of the events change over time. We then describe a particle filter that can efficiently and accurately estimate the parameters of the process generating periodic events intermingled with independent noise events. The system has a small memory footprint, and, unlike alternative methods, its computational complexity is constant in the number of events that have been observed. As a result, it can be applied in low-resource settings that require real-time performance over long periods of time. In experiments on real and simulated data we find that it outperforms existing methods in accuracy and can track changes in periodicity and other characteristics in dynamic event streams.

References

  1. Apache commons math 3.6.1. Binary, 2016.Google ScholarGoogle Scholar
  2. Dataset. text files, 2017.Google ScholarGoogle Scholar
  3. Jens Barth, Jochen Klucken, Patrick Kugler, Thomas Kammerer, Ralph Steidl, Jürgen Winkler, Joachim Hornegger, and Björn Eskofier. Biometric and mobile gait analysis for early diagnosis and therapy monitoring in parkinson's disease. In Engineering in Medicine and Biology Society, EMBC, 2011 Annual International Conference of the IEEE, pages 868--871. IEEE, 2011.Google ScholarGoogle Scholar
  4. Theophilus Benson, Aditya Akella, and David A Maltz. Network traffic characteristics of data centers in the wild. In Proceedings of the 10th ACM SIGCOMM conference on Internet measurement, pages 267--280. ACM, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Kevin R Canini, Lei Shi, and Thomas L Griffiths. Online inference of topics with latent dirichlet allocation. In International conference on artificial intelligence and statistics, pages 65--72, 2009.Google ScholarGoogle Scholar
  6. Chen-Mou Cheng, HT Kung, and Koan-Sin Tan. Use of spectral analysis in defense against dos attacks. In Global Telecommunications Conference, 2002. GLOBECOM'02. IEEE, volume 3, pages 2143--2148. IEEE, 2002.Google ScholarGoogle ScholarCross RefCross Ref
  7. A. Doucet, N. de Freitas, and N. Gordon, editors. Sequential Monte Carlo Methods in Practice. Springer, New York, 2001.Google ScholarGoogle ScholarCross RefCross Ref
  8. David Easley and Jon Kleinberg. Networks, crowds, and markets: Reasoning about a highly connected world. Cambridge University Press, 2010. Google ScholarGoogle ScholarCross RefCross Ref
  9. Nooshin Haji Ghassemi and M. Diesenroth. Analytic long term forecasting with periodic gaussian processes. In AISTATS, pages 303--311, 2014.Google ScholarGoogle Scholar
  10. Jiawei Han, Guozhu Dong, and Yiwen Yin. Efficient mining of partial periodic patterns in time series database. In Data Engineering, 1999. Proceedings of the 15th International Conference on, pages 106--115. IEEE, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Piotr Indyk, Nick Koudas, and S Muthukrishnan. Identifying representative trends in massive time series data sets using sketches. In VLDB, pages 363--372, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Tanvi Jindal, Prasanna Giridhar, Lu-An Tang, Jun Li, and Jiawei Han. Spatiotemporal periodical pattern mining in traffic data. In Proceedings of the 2nd ACM SIGKDD International Workshop on Urban Computing, page 11. ACM, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Ivan Junier, Joan Hérisson, and Franccois Képès. Periodic pattern detection in sparse boolean sequences. Algorithms for Molecular Biology, 5(1):1, 2010.Google ScholarGoogle ScholarCross RefCross Ref
  14. Panagiota Katsikouli, Rik Sarkar, and Jie Gao. Persistence based online signal and trajectory simplification for mobile devices. In Proceedings of the 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pages 371--380. ACM, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Jochen Klucken, Jens Barth, Patrick Kugler, Johannes Schlachetzki, Thore Henze, Franz Marxreiter, Zacharias Kohl, Ralph Steidl, Joachim Hornegger, Bjoern Eskofier, et al. Unbiased and mobile gait analysis detects motor impairment in parkinson's disease. PloS one, 8(2):e56956, 2013.Google ScholarGoogle ScholarCross RefCross Ref
  16. Jennifer R Kwapisz, Gary M Weiss, and Samuel A Moore. Activity recognition using cell phone accelerometers. ACM SigKDD Explorations Newsletter, 12(2):74--82, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Nicholas D Lane, Emiliano Miluzzo, Hong Lu, Daniel Peebles, Tanzeem Choudhury, and Andrew T Campbell. A survey of mobile phone sensing. IEEE Communications magazine, 48(9), 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Zhenhui Li, Jingjing Wang, and Jiawei Han. Mining event periodicity from incomplete observations. In Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 444--452. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Zhenhui Li, Jingjing Wang, and Jiawei Han. eperiodicity: Mining event periodicity from incomplete observations. IEEE Transactions on Knowledge and Data Engineering, 27(5):1219--1232, 2015.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Katja Nummiaro, Esther Koller-Meier, and Luc Van Gool. An adaptive color-based particle filter. Image and vision computing, 21(1):99--110, 2003.Google ScholarGoogle Scholar
  21. Michael A Osborne, Stephen J Roberts, Alex Rogers, Sarvapali D Ramchurn, and Nicholas R Jennings. Towards real-time information processing of sensor network data using computationally efficient multi-output gaussian processes. In Proceedings of the 7th international conference on Information processing in sensor networks, pages 109--120. IEEE Computer Society, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Valentin Radu, Panagiota Katsikouli, Rik Sarkar, and Mahesh K Marina. A semi-supervised learning approach for robust indoor-outdoor detection with smartphones. In Proceedings of the 12th ACM Conference on Embedded Network Sensor Systems, pages 280--294. ACM, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Leland Stewart and Perry McCarty Jr. Use of bayesian belief networks to fuse continuous and discrete information for target recognition, tracking, and situation assessment. pages 177--185, 1992.Google ScholarGoogle Scholar
  24. Sebastian Thrun, Wolfram Burgard, and Dieter Fox. Probabilistic robotics. MIT press, 2005.Google ScholarGoogle Scholar
  25. Michail Vlachos, S Yu Philip, and Vittorio Castelli. On periodicity detection and structural periodic similarity. In SDM, volume 5, pages 449--460. SIAM, 2005.Google ScholarGoogle ScholarCross RefCross Ref
  26. Jiong Yang, Wei Wang, and Philip S. Yu. Mining asynchronous periodic patterns in time series data. IEEE Transactions on Knowledge and Data Engineering, 15(3):613--628, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Finding Periodic Discrete Events in Noisy Streams

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CIKM '17: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management
      November 2017
      2604 pages
      ISBN:9781450349185
      DOI:10.1145/3132847

      Copyright © 2017 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 6 November 2017

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      CIKM '17 Paper Acceptance Rate171of855submissions,20%Overall Acceptance Rate1,861of8,427submissions,22%

      Upcoming Conference

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader