skip to main content
research-article

Training-Free Human Vitality Monitoring Using Commodity Wi-Fi Devices

Authors Info & Claims
Published:18 September 2018Publication History
Skip Abstract Section

Abstract

Device-free sensing using ubiquitous Wi-Fi signals has recently attracted lots of attention. Among the sensed information, two important basic contexts are (i) whether a target is still or not and (ii) where the target is located. Continuous monitoring of these contexts provides us with rich datasets to obtain important high-level semantics of the target such as living habits, physical conditions and emotions. However, even to obtain these two basic contexts, offline training and calibration are needed in traditional methods, limiting the real-life adoption of the proposed sensing systems. In this paper, using the commodity Wi-Fi infrastructure, we propose a training-free human vitality sensing platform, WiVit. It could capture these two contexts together with the target's movements speed information in real-time without any human effort in offline training or calibration. Based on our extensive experiments in three typical indoor environments, the precision of activity detection is higher than 98% and the area detection accuracy is close to 100%. Moreover, we implement a short-term activity recognition system on our platform to recognize 4 types of actions, and we can reach an average accuracy of 94.2%. We also take a feasibility study of monitoring long-term activities of daily living to show our platform's potential applications in practice.

Skip Supplemental Material Section

Supplemental Material

References

  1. Heba Abdel-Nasser, Reham Samir, Ibrahim Sabek, and Moustafa Youssef. 2013. MonoPHY: Mono-stream-based device-free WLAN localization via physical layer information. In 2013 IEEE Wireless Communications and Networking Conference (WCNC). 4546--4551.Google ScholarGoogle ScholarCross RefCross Ref
  2. Fadel Adib, Zach Kabelac, Dina Katabi, and Robert C. Miller. 2014. 3D Tracking via Body Radio Reflections. In Proceedings of the 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI '14). USENIX Association, Seattle, WA, 317--329. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Paramvir Bahl and Venkata N. Padmanabhan. 2000. RADAR: an in-building RF-based user location and tracking system. In Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064), Vol. 2. IEEE, 775--784 vol.2.Google ScholarGoogle ScholarCross RefCross Ref
  4. Agata Brajdic and Robert Harle. 2012. Scalable Indoor Pedestrian Localization Using Inertial Sensing and Parallel Particle Filters. In Proceedings of 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN '12). IEEE, 1--10.Google ScholarGoogle ScholarCross RefCross Ref
  5. Q. Cai and J. K. Aggarwal. 1998. Automatic Tracking of Human Motion in Indoor Scenes across Multiple Synchronized Video Streams. In Proceedings of the Sixth International Conference on Computer Vision (ICCV '98). IEEE, 356--362. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Liming Chen and Hui Nugent, Chris D. and Wang. 2012. A Knowledge-Driven Approach to Activity Recognition in Smart Homes. IEEE Transactions on Knowledge and Data Engineering 24, 6 (June 2012), 961--974. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Mohamed Eldib, Francis Deboeverie, Wilfried Philips, and Hamid Aghajan. 2016. Behavior Analysis for Elderly Care Using A Network of Low-Resolution Visual Sensors. J. Electron. Imaging 25, 4 (Mar 2016), 17.Google ScholarGoogle ScholarCross RefCross Ref
  8. Tao Gu, Liang Wang, Zhanqing Wu, Xianping Tao, and Jian Lu. 2011. A Pattern Mining Approach to Sensor-Based Human Activity Recognition. IEEE Transactions on Knowledge and Data Engineering 23, 9 (Sept 2011), 1359--1372. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Yu Gu, Jinhai Zhan, Yusheng Ji, Jie Li, Fuji Ren, and Shangbing Gao. 2017. MoSense: An RF-Based Motion Detection System via Off-the-Shelf Wi-Fi Devices. IEEE Internet of Things Journal 4, 6 (Dec 2017), 2326--2341.Google ScholarGoogle ScholarCross RefCross Ref
  10. Daniel Halperin, Wenjun Hu, Anmol Sheth, and David Wetherall. 2011. Tool Release: Gathering 802.11N Traces with Channel State Information. SIGCOMM Comput. Commun. Rev. 41, 1 (Jan. 2011), 53--53. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Ju Han and Bir Bhanu. 2005. Human Activity Recognition in Thermal Infrared Imagery. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '05) - Workshops - Volume 03 (CVPR '05). IEEE, Washington, DC, USA, 17--17. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Derek Hao Hu, Sinno Jialin Pan, Vincent Wenchen Zheng, Nathan Nan Liu, and Qiang Yang. 2008. Real World Activity Recognition with Multiple Goals. In Proceedings of the 10th International Conference on Ubiquitous Computing (UbiComp '08). ACM, New York, NY, USA, 30--39. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Pan Hu, Liqun Li, Chunyi Peng, Guobin Shen, and Feng Zhao. 2013. Pharos: Enable Physical Analytics Through Visible Light Based Indoor Localization. In Proceedings of the Twelfth ACM Workshop on Hot Topics in Networks (HotNets-XII). ACM, New York, NY, USA, Article 5, 7 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Jung-Yoon Kim, Na Liu, Hwee-Xian Tan, and Chao-Hsien Chu. 2017. Unobtrusive Monitoring to Detect Depression for Elderly With Chronic Illnesses. IEEE Sensors Journal 17, 17 (Sept 2017), 5694--5704.Google ScholarGoogle ScholarCross RefCross Ref
  15. Ahmed E. Kosba, Ahmed Saeed, and Moustafa Youssef. 2012. RASID: A robust WLAN device-free passive motion detection system. In 2012 IEEE International Conference on Pervasive Computing and Communications. 180--189.Google ScholarGoogle ScholarCross RefCross Ref
  16. Manikanta Kotaru, Kiran Joshi, Dinesh Bharadia, and Sachin Katti. 2015. SpotFi: Decimeter Level Localization Using Wi-Fi. In Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication (SIGCOMM '15). ACM, New York, NY, USA, 269--282. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Ye-Sheng Kuo, Pat Pannuto, Ko-Jen Hsiao, and Prabal Dutta. 2014. Luxapose: Indoor Positioning with Mobile Phones and Visible Light. In Proceedings of the 20th Annual International Conference on Mobile Computing and Networking (MobiCom '14). ACM, New York, NY, USA, 447--458. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Hong Li, Wei Yang, Jianxin Wang, Yang Xu, and Liusheng Huang. 2016. Wi-Finger: Talk to Your Smart Devices with Finger-grained Gesture. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 250--261. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Shengjie Li, Xiang Li, Kai Niu, Hao Wang, Yue Zhang, and Daqing Zhang. 2017. AR-Alarm: An Adaptive and Robust Intrusion Detection System Leveraging CSI from Commodity Wi-Fi. In International Conference on Smart Homes and Health Telematics (ICOST '17). Springer International Publishing, 211--223.Google ScholarGoogle ScholarCross RefCross Ref
  20. Xiang Li, Shengjie Li, Daqing Zhang, Jie Xiong, Yasha Wang, and Hong Mei. 2016. Dynamic-MUSIC: Accurate Device-free Indoor Localization. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 196--207. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Xiang Li, Daqing Zhang, Qin Lv, Jie Xiong, Shengjie Li, Yue Zhang, and Hong Mei. 2017. IndoTrack: Device-Free Indoor Human Tracking with Commodity Wi-Fi. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 72 (Sept. 2017), 22 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Xuefeng Liu, Jiannong Cao, Shaojie Tang, Jiaqi Wen, and Peng Guo. 2016. Contactless Respiration Monitoring Via Off-the-Shelf Wi-Fi Devices. IEEE Transactions on Mobile Computing 15, 10 (Oct 2016), 2466--2479.Google ScholarGoogle ScholarCross RefCross Ref
  23. Beth Logan, Jennifer Healey, Matthai Philipose, Emmanuel Munguia Tapia, and Stephen Intille. 2007. A Long-Term Evaluation of Sensing Modalities for Activity Recognition. In UbiComp 2007: Ubiquitous Computing. Springer Berlin Heidelberg, Berlin, Heidelberg, 483--500. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Wenguang Mao, Jian He, and Lili Qiu. 2016. CAT: High-precision Acoustic Motion Tracking. In Proceedings of the 22Nd Annual International Conference on Mobile Computing and Networking (MobiCom '16). ACM, New York, NY, USA, 69--81. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Elizabeth D. Mynatt, Jim Rowan, Sarah Craighill, and Annie Jacobs. 2001. Digital Family Portraits: Supporting Peace of Mind for Extended Family Members. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '01). ACM, New York, NY, USA, 333--340. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Katsunori Ohnishi, Atsushi Kanehira, Asako Kanezaki, and Tatsuya Harada. 2016. Recognizing Activities of Daily Living With a Wrist-Mounted Camera. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR '16). 3103--3111.Google ScholarGoogle ScholarCross RefCross Ref
  27. Qifan Pu, Sidhant Gupta, Shyamnath Gollakota, and Shwetak Patel. 2013. Whole-home Gesture Recognition Using Wireless Signals. In Proceedings of the 19th Annual International Conference on Mobile Computing and Networking (MobiCom '13). ACM, New York, NY, USA, 27--38. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Kun Qian, Chenshu Wu, Zheng Yang, Yunhao Liu, and Zimu Zhou. 2014. PADS: Passive detection of moving targets with dynamic speed using PHY layer information. In 2014 20th IEEE International Conference on Parallel and Distributed Systems (ICPADS). 1--8.Google ScholarGoogle ScholarCross RefCross Ref
  29. Kun Qian, Chenshu Wu, Zheng Yang, Chaofan Yang, and Yunhao Liu. 2016. Decimeter Level Passive Tracking with Wi-Fi. In Proceedings of the 3rd Workshop on Hot Topics in Wireless (HotWireless '16). ACM, New York, NY, USA, 44--48. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Daniele Riboni, Timo Sztyler, Gabriele Civitarese, and Heiner Stuckenschmidt. 2016. Unsupervised Recognition of Interleaved Activities of Daily Living Through Ontological and Probabilistic Reasoning. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 1--12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Ahmed Saeed, Ahmed E. Kosba, and Moustafa Youssef. 2014. Ichnaea: A Low-Overhead Robust WLAN Device-Free Passive Localization System. IEEE Journal of Selected Topics in Signal Processing 8, 1 (Feb 2014), 5--15.Google ScholarGoogle ScholarCross RefCross Ref
  32. R. Schmidt. 1986. Multiple Emitter Location and Signal Parameter Estimation. IEEE Transactions on Antennas and Propagation 34, 3 (Mar 1986), 276--280.Google ScholarGoogle ScholarCross RefCross Ref
  33. Moustafa Seifeldin, Ahmed Saeed, Ahmed E. Kosba, Amr El-Keyi, and Moustafa Youssef. 2013. Nuzzer: A Large-Scale Device-Free Passive Localization System for Wireless Environments. IEEE Trans. Mobile Computing 12, 7 (July 2013), 1321--1334. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Byunghun Song, Haksoo Choi, and Hyung Su Lee. 2008. Surveillance Tracking System Using Passive Infrared Motion Sensors in Wireless Sensor Network. In 2008 International Conference on Information Networking. 1--5.Google ScholarGoogle Scholar
  35. Hao Wang, Daqing Zhang, Junyi Ma, Yasha Wang, Yuxiang Wang, Dan Wu, Tao Gu, and Bing Xie. 2016. Human Respiration Detection with Commodity Wifi Devices: Do User Location and Body Orientation Matter?. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 25--36. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Hao Wang, Daqing Zhang, Kai Niu, Qin Lv, Yuanhuai Liu, Dan Wu, Ruiyang Gao, and Bing Xie. 2017. MFDL: A Multicarrier Fresnel Penetration Model based Device-Free Localization System leveraging Commodity Wi-Fi Cards. CoRR abs/1707.07514 (2017). arXiv:1707.07514Google ScholarGoogle Scholar
  37. Hao Wang, Daqing Zhang, Yasha Wang, Junyi Ma, Yuxiang Wang, and Shengjie Li. 2017. RT-Fall: A Real-Time and Contactless Fall Detection System with Commodity Wi-Fi Devices. IEEE Transactions on Mobile Computing 16, 2 (Feb 2017), 511--526. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Ju Wang, Hongbo Jiang, Jie Xiong, Kyle Jamieson, Xiaojiang Chen, Dingyi Fang, and Binbin Xie. 2016. LiFS: Low Human-effort, Device-free Localization with Fine-grained Subcarrier Information. In Proceedings of the 22Nd Annual International Conference on Mobile Computing and Networking (MobiCom '16). ACM, New York, NY, USA, 243--256. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Wei Wang, Alex X. Liu, Muhammad Shahzad, Kang Ling, and Sanglu Lu. 2015. Understanding and Modeling of Wi-Fi Signal Based Human Activity Recognition. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking (MobiCom '15). ACM, New York, NY, USA, 65--76. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Wei Wang, Alex X. Liu, Muhammad Shahzad, Kang Ling, and Sanglu Lu. 2017. Device-Free Human Activity Recognition Using Commercial Wi-Fi Devices. IEEE Journal on Selected Areas in Communications 35, 5 (May 2017), 1118--1131.Google ScholarGoogle ScholarCross RefCross Ref
  41. Wei Wang, Alex X. Liu, and Ke Sun. 2016. Device-free Gesture Tracking Using Acoustic Signals. In Proceedings of the 22Nd Annual International Conference on Mobile Computing and Networking (MobiCom '16). ACM, New York, NY, USA, 82--94. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Yan Wang, Jian Liu, Yingying Chen, Marco Gruteser, Jie Yang, and Hongbo Liu. 2014. E-eyes: Device-free Location-oriented Activity Identification Using Fine-grained Wi-Fi Signatures. In Proceedings of the 20th Annual International Conference on Mobile Computing and Networking (MobiCom '14). ACM, New York, NY, USA, 617--628. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Lloyd R. Welch. 2003. Hidden Markov Models and the Baum-Welch Algorithm. 53, 4 (Dec 2003), 10--13.Google ScholarGoogle Scholar
  44. Wi-Fi Alliance® 6 for '16 Wi-Fi® predictions 2016. Retrieved January 31, 2018 from https://www.wifi.org/beacon/wifi-alliance/wifi-alliance-6-for-16-wifi-predictionsGoogle ScholarGoogle Scholar
  45. Oliver Woodman and Robert Harle. 2009. RF-Based Initialization for Inertial Pedestrian Tracking. In Proceedings of the 7th International Conference on Pervasive Computing (Pervasive '09). Springer-Verlag, Berlin, Heidelberg, 238--255. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Chenshu Wu, Zheng Yang, Zimu Zhou, Xuefeng Liu, Yunhao Liu, and Jiannong Cao. 2015. Non-Invasive Detection of Moving and Stationary Human With Wi-Fi. IEEE Journal on Selected Areas in Communications 33, 11 (Nov 2015), 2329--2342.Google ScholarGoogle ScholarCross RefCross Ref
  47. Jiang Xiao, Kaishun Wu, Youwen Yi, Lu Wang, and Lionel M. Ni. 2012. FIMD: Fine-grained Device-free Motion Detection. In 2012 IEEE 18th International Conference on Parallel and Distributed Systems. 229--235. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Jiang Xiao, Kaishun Wu, Youwen Yi, Lu Wang, and Lionel M. Ni. 2013. Pilot: Passive Device-Free Indoor Localization Using Channel State Information. In 2013 IEEE 33rd International Conference on Distributed Computing Systems. 236--245. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Jie Xiong and Kyle Jamieson. 2013. ArrayTrack: A Fine-grained Indoor Location System. In Proceedings of the 10th USENIX Conference on Networked Systems Design and Implementation (NSDI '13). USENIX Association, Berkeley, CA, USA, 71--84. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Jie Xiong, Karthikeyan Sundaresan, and Kyle Jamieson. 2015. Tone-Track: Leveraging Frequency-Agile Radios for Time-Based Indoor Wireless Localization. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking (MobiCom '15). ACM, New York, NY, USA, 537--549. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Moustafa Youssef and Ashok Agrawala. 2005. The Horus WLAN Location Determination System. In Proceedings of the 3rd International Conference on Mobile Systems, Applications, and Services (MobiSys '05). ACM, New York, NY, USA, 205--218. Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Moustafa Youssef, Matthew Mah, and Ashok Agrawala. 2007. Challenges: Device-free Passive Localization for Wireless Environments. In Proceedings of the 13th Annual ACM International Conference on Mobile Computing and Networking (MobiCom '07). ACM, New York, NY, USA, 222--229. Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Zhaoyuan Yu, Linwang Yuan, Wen Luo, Linyao Feng, and Guonian Lv. 2016. Spatio-Temporal Constrained Human Trajectory Generation from the PIR Motion Detector Sensor Network Data: A Geometric Algebra Approach. Sensors 16, 1 (2016).Google ScholarGoogle Scholar
  54. Fusang Zhang, Daqing Zhang, Jie Xiong, Hao Wang, Kai Niu, Beihong Jin, and Yuxiang Wang. 2018. From Fresnel Diffraction Model to Fine-grained Human Respiration Sensing with Commodity Wi-Fi Devices. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 1, Article 53 (March 2018), 23 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Training-Free Human Vitality Monitoring Using Commodity Wi-Fi Devices

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
      Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 2, Issue 3
      September 2018
      1536 pages
      EISSN:2474-9567
      DOI:10.1145/3279953
      Issue’s Table of Contents

      Copyright © 2018 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 18 September 2018
      • Accepted: 1 August 2018
      • Revised: 1 May 2018
      • Received: 1 February 2018
      Published in imwut Volume 2, Issue 3

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader