Abstract
Device-free sensing using ubiquitous Wi-Fi signals has recently attracted lots of attention. Among the sensed information, two important basic contexts are (i) whether a target is still or not and (ii) where the target is located. Continuous monitoring of these contexts provides us with rich datasets to obtain important high-level semantics of the target such as living habits, physical conditions and emotions. However, even to obtain these two basic contexts, offline training and calibration are needed in traditional methods, limiting the real-life adoption of the proposed sensing systems. In this paper, using the commodity Wi-Fi infrastructure, we propose a training-free human vitality sensing platform, WiVit. It could capture these two contexts together with the target's movements speed information in real-time without any human effort in offline training or calibration. Based on our extensive experiments in three typical indoor environments, the precision of activity detection is higher than 98% and the area detection accuracy is close to 100%. Moreover, we implement a short-term activity recognition system on our platform to recognize 4 types of actions, and we can reach an average accuracy of 94.2%. We also take a feasibility study of monitoring long-term activities of daily living to show our platform's potential applications in practice.
Supplemental Material
Available for Download
Supplemental movie, appendix, image and software files for, Training-Free Human Vitality Monitoring Using Commodity Wi-Fi Devices
- Heba Abdel-Nasser, Reham Samir, Ibrahim Sabek, and Moustafa Youssef. 2013. MonoPHY: Mono-stream-based device-free WLAN localization via physical layer information. In 2013 IEEE Wireless Communications and Networking Conference (WCNC). 4546--4551.Google ScholarCross Ref
- Fadel Adib, Zach Kabelac, Dina Katabi, and Robert C. Miller. 2014. 3D Tracking via Body Radio Reflections. In Proceedings of the 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI '14). USENIX Association, Seattle, WA, 317--329. Google ScholarDigital Library
- Paramvir Bahl and Venkata N. Padmanabhan. 2000. RADAR: an in-building RF-based user location and tracking system. In Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064), Vol. 2. IEEE, 775--784 vol.2.Google ScholarCross Ref
- Agata Brajdic and Robert Harle. 2012. Scalable Indoor Pedestrian Localization Using Inertial Sensing and Parallel Particle Filters. In Proceedings of 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN '12). IEEE, 1--10.Google ScholarCross Ref
- Q. Cai and J. K. Aggarwal. 1998. Automatic Tracking of Human Motion in Indoor Scenes across Multiple Synchronized Video Streams. In Proceedings of the Sixth International Conference on Computer Vision (ICCV '98). IEEE, 356--362. Google ScholarDigital Library
- Liming Chen and Hui Nugent, Chris D. and Wang. 2012. A Knowledge-Driven Approach to Activity Recognition in Smart Homes. IEEE Transactions on Knowledge and Data Engineering 24, 6 (June 2012), 961--974. Google ScholarDigital Library
- Mohamed Eldib, Francis Deboeverie, Wilfried Philips, and Hamid Aghajan. 2016. Behavior Analysis for Elderly Care Using A Network of Low-Resolution Visual Sensors. J. Electron. Imaging 25, 4 (Mar 2016), 17.Google ScholarCross Ref
- Tao Gu, Liang Wang, Zhanqing Wu, Xianping Tao, and Jian Lu. 2011. A Pattern Mining Approach to Sensor-Based Human Activity Recognition. IEEE Transactions on Knowledge and Data Engineering 23, 9 (Sept 2011), 1359--1372. Google ScholarDigital Library
- Yu Gu, Jinhai Zhan, Yusheng Ji, Jie Li, Fuji Ren, and Shangbing Gao. 2017. MoSense: An RF-Based Motion Detection System via Off-the-Shelf Wi-Fi Devices. IEEE Internet of Things Journal 4, 6 (Dec 2017), 2326--2341.Google ScholarCross Ref
- Daniel Halperin, Wenjun Hu, Anmol Sheth, and David Wetherall. 2011. Tool Release: Gathering 802.11N Traces with Channel State Information. SIGCOMM Comput. Commun. Rev. 41, 1 (Jan. 2011), 53--53. Google ScholarDigital Library
- Ju Han and Bir Bhanu. 2005. Human Activity Recognition in Thermal Infrared Imagery. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '05) - Workshops - Volume 03 (CVPR '05). IEEE, Washington, DC, USA, 17--17. Google ScholarDigital Library
- Derek Hao Hu, Sinno Jialin Pan, Vincent Wenchen Zheng, Nathan Nan Liu, and Qiang Yang. 2008. Real World Activity Recognition with Multiple Goals. In Proceedings of the 10th International Conference on Ubiquitous Computing (UbiComp '08). ACM, New York, NY, USA, 30--39. Google ScholarDigital Library
- Pan Hu, Liqun Li, Chunyi Peng, Guobin Shen, and Feng Zhao. 2013. Pharos: Enable Physical Analytics Through Visible Light Based Indoor Localization. In Proceedings of the Twelfth ACM Workshop on Hot Topics in Networks (HotNets-XII). ACM, New York, NY, USA, Article 5, 7 pages. Google ScholarDigital Library
- Jung-Yoon Kim, Na Liu, Hwee-Xian Tan, and Chao-Hsien Chu. 2017. Unobtrusive Monitoring to Detect Depression for Elderly With Chronic Illnesses. IEEE Sensors Journal 17, 17 (Sept 2017), 5694--5704.Google ScholarCross Ref
- Ahmed E. Kosba, Ahmed Saeed, and Moustafa Youssef. 2012. RASID: A robust WLAN device-free passive motion detection system. In 2012 IEEE International Conference on Pervasive Computing and Communications. 180--189.Google ScholarCross Ref
- Manikanta Kotaru, Kiran Joshi, Dinesh Bharadia, and Sachin Katti. 2015. SpotFi: Decimeter Level Localization Using Wi-Fi. In Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication (SIGCOMM '15). ACM, New York, NY, USA, 269--282. Google ScholarDigital Library
- Ye-Sheng Kuo, Pat Pannuto, Ko-Jen Hsiao, and Prabal Dutta. 2014. Luxapose: Indoor Positioning with Mobile Phones and Visible Light. In Proceedings of the 20th Annual International Conference on Mobile Computing and Networking (MobiCom '14). ACM, New York, NY, USA, 447--458. Google ScholarDigital Library
- Hong Li, Wei Yang, Jianxin Wang, Yang Xu, and Liusheng Huang. 2016. Wi-Finger: Talk to Your Smart Devices with Finger-grained Gesture. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 250--261. Google ScholarDigital Library
- Shengjie Li, Xiang Li, Kai Niu, Hao Wang, Yue Zhang, and Daqing Zhang. 2017. AR-Alarm: An Adaptive and Robust Intrusion Detection System Leveraging CSI from Commodity Wi-Fi. In International Conference on Smart Homes and Health Telematics (ICOST '17). Springer International Publishing, 211--223.Google ScholarCross Ref
- Xiang Li, Shengjie Li, Daqing Zhang, Jie Xiong, Yasha Wang, and Hong Mei. 2016. Dynamic-MUSIC: Accurate Device-free Indoor Localization. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 196--207. Google ScholarDigital Library
- Xiang Li, Daqing Zhang, Qin Lv, Jie Xiong, Shengjie Li, Yue Zhang, and Hong Mei. 2017. IndoTrack: Device-Free Indoor Human Tracking with Commodity Wi-Fi. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 72 (Sept. 2017), 22 pages. Google ScholarDigital Library
- Xuefeng Liu, Jiannong Cao, Shaojie Tang, Jiaqi Wen, and Peng Guo. 2016. Contactless Respiration Monitoring Via Off-the-Shelf Wi-Fi Devices. IEEE Transactions on Mobile Computing 15, 10 (Oct 2016), 2466--2479.Google ScholarCross Ref
- Beth Logan, Jennifer Healey, Matthai Philipose, Emmanuel Munguia Tapia, and Stephen Intille. 2007. A Long-Term Evaluation of Sensing Modalities for Activity Recognition. In UbiComp 2007: Ubiquitous Computing. Springer Berlin Heidelberg, Berlin, Heidelberg, 483--500. Google ScholarDigital Library
- Wenguang Mao, Jian He, and Lili Qiu. 2016. CAT: High-precision Acoustic Motion Tracking. In Proceedings of the 22Nd Annual International Conference on Mobile Computing and Networking (MobiCom '16). ACM, New York, NY, USA, 69--81. Google ScholarDigital Library
- Elizabeth D. Mynatt, Jim Rowan, Sarah Craighill, and Annie Jacobs. 2001. Digital Family Portraits: Supporting Peace of Mind for Extended Family Members. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '01). ACM, New York, NY, USA, 333--340. Google ScholarDigital Library
- Katsunori Ohnishi, Atsushi Kanehira, Asako Kanezaki, and Tatsuya Harada. 2016. Recognizing Activities of Daily Living With a Wrist-Mounted Camera. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR '16). 3103--3111.Google ScholarCross Ref
- Qifan Pu, Sidhant Gupta, Shyamnath Gollakota, and Shwetak Patel. 2013. Whole-home Gesture Recognition Using Wireless Signals. In Proceedings of the 19th Annual International Conference on Mobile Computing and Networking (MobiCom '13). ACM, New York, NY, USA, 27--38. Google ScholarDigital Library
- Kun Qian, Chenshu Wu, Zheng Yang, Yunhao Liu, and Zimu Zhou. 2014. PADS: Passive detection of moving targets with dynamic speed using PHY layer information. In 2014 20th IEEE International Conference on Parallel and Distributed Systems (ICPADS). 1--8.Google ScholarCross Ref
- Kun Qian, Chenshu Wu, Zheng Yang, Chaofan Yang, and Yunhao Liu. 2016. Decimeter Level Passive Tracking with Wi-Fi. In Proceedings of the 3rd Workshop on Hot Topics in Wireless (HotWireless '16). ACM, New York, NY, USA, 44--48. Google ScholarDigital Library
- Daniele Riboni, Timo Sztyler, Gabriele Civitarese, and Heiner Stuckenschmidt. 2016. Unsupervised Recognition of Interleaved Activities of Daily Living Through Ontological and Probabilistic Reasoning. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 1--12. Google ScholarDigital Library
- Ahmed Saeed, Ahmed E. Kosba, and Moustafa Youssef. 2014. Ichnaea: A Low-Overhead Robust WLAN Device-Free Passive Localization System. IEEE Journal of Selected Topics in Signal Processing 8, 1 (Feb 2014), 5--15.Google ScholarCross Ref
- R. Schmidt. 1986. Multiple Emitter Location and Signal Parameter Estimation. IEEE Transactions on Antennas and Propagation 34, 3 (Mar 1986), 276--280.Google ScholarCross Ref
- Moustafa Seifeldin, Ahmed Saeed, Ahmed E. Kosba, Amr El-Keyi, and Moustafa Youssef. 2013. Nuzzer: A Large-Scale Device-Free Passive Localization System for Wireless Environments. IEEE Trans. Mobile Computing 12, 7 (July 2013), 1321--1334. Google ScholarDigital Library
- Byunghun Song, Haksoo Choi, and Hyung Su Lee. 2008. Surveillance Tracking System Using Passive Infrared Motion Sensors in Wireless Sensor Network. In 2008 International Conference on Information Networking. 1--5.Google Scholar
- Hao Wang, Daqing Zhang, Junyi Ma, Yasha Wang, Yuxiang Wang, Dan Wu, Tao Gu, and Bing Xie. 2016. Human Respiration Detection with Commodity Wifi Devices: Do User Location and Body Orientation Matter?. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 25--36. Google ScholarDigital Library
- Hao Wang, Daqing Zhang, Kai Niu, Qin Lv, Yuanhuai Liu, Dan Wu, Ruiyang Gao, and Bing Xie. 2017. MFDL: A Multicarrier Fresnel Penetration Model based Device-Free Localization System leveraging Commodity Wi-Fi Cards. CoRR abs/1707.07514 (2017). arXiv:1707.07514Google Scholar
- Hao Wang, Daqing Zhang, Yasha Wang, Junyi Ma, Yuxiang Wang, and Shengjie Li. 2017. RT-Fall: A Real-Time and Contactless Fall Detection System with Commodity Wi-Fi Devices. IEEE Transactions on Mobile Computing 16, 2 (Feb 2017), 511--526. Google ScholarDigital Library
- Ju Wang, Hongbo Jiang, Jie Xiong, Kyle Jamieson, Xiaojiang Chen, Dingyi Fang, and Binbin Xie. 2016. LiFS: Low Human-effort, Device-free Localization with Fine-grained Subcarrier Information. In Proceedings of the 22Nd Annual International Conference on Mobile Computing and Networking (MobiCom '16). ACM, New York, NY, USA, 243--256. Google ScholarDigital Library
- Wei Wang, Alex X. Liu, Muhammad Shahzad, Kang Ling, and Sanglu Lu. 2015. Understanding and Modeling of Wi-Fi Signal Based Human Activity Recognition. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking (MobiCom '15). ACM, New York, NY, USA, 65--76. Google ScholarDigital Library
- Wei Wang, Alex X. Liu, Muhammad Shahzad, Kang Ling, and Sanglu Lu. 2017. Device-Free Human Activity Recognition Using Commercial Wi-Fi Devices. IEEE Journal on Selected Areas in Communications 35, 5 (May 2017), 1118--1131.Google ScholarCross Ref
- Wei Wang, Alex X. Liu, and Ke Sun. 2016. Device-free Gesture Tracking Using Acoustic Signals. In Proceedings of the 22Nd Annual International Conference on Mobile Computing and Networking (MobiCom '16). ACM, New York, NY, USA, 82--94. Google ScholarDigital Library
- Yan Wang, Jian Liu, Yingying Chen, Marco Gruteser, Jie Yang, and Hongbo Liu. 2014. E-eyes: Device-free Location-oriented Activity Identification Using Fine-grained Wi-Fi Signatures. In Proceedings of the 20th Annual International Conference on Mobile Computing and Networking (MobiCom '14). ACM, New York, NY, USA, 617--628. Google ScholarDigital Library
- Lloyd R. Welch. 2003. Hidden Markov Models and the Baum-Welch Algorithm. 53, 4 (Dec 2003), 10--13.Google Scholar
- Wi-Fi Alliance® 6 for '16 Wi-Fi® predictions 2016. Retrieved January 31, 2018 from https://www.wifi.org/beacon/wifi-alliance/wifi-alliance-6-for-16-wifi-predictionsGoogle Scholar
- Oliver Woodman and Robert Harle. 2009. RF-Based Initialization for Inertial Pedestrian Tracking. In Proceedings of the 7th International Conference on Pervasive Computing (Pervasive '09). Springer-Verlag, Berlin, Heidelberg, 238--255. Google ScholarDigital Library
- Chenshu Wu, Zheng Yang, Zimu Zhou, Xuefeng Liu, Yunhao Liu, and Jiannong Cao. 2015. Non-Invasive Detection of Moving and Stationary Human With Wi-Fi. IEEE Journal on Selected Areas in Communications 33, 11 (Nov 2015), 2329--2342.Google ScholarCross Ref
- Jiang Xiao, Kaishun Wu, Youwen Yi, Lu Wang, and Lionel M. Ni. 2012. FIMD: Fine-grained Device-free Motion Detection. In 2012 IEEE 18th International Conference on Parallel and Distributed Systems. 229--235. Google ScholarDigital Library
- Jiang Xiao, Kaishun Wu, Youwen Yi, Lu Wang, and Lionel M. Ni. 2013. Pilot: Passive Device-Free Indoor Localization Using Channel State Information. In 2013 IEEE 33rd International Conference on Distributed Computing Systems. 236--245. Google ScholarDigital Library
- Jie Xiong and Kyle Jamieson. 2013. ArrayTrack: A Fine-grained Indoor Location System. In Proceedings of the 10th USENIX Conference on Networked Systems Design and Implementation (NSDI '13). USENIX Association, Berkeley, CA, USA, 71--84. Google ScholarDigital Library
- Jie Xiong, Karthikeyan Sundaresan, and Kyle Jamieson. 2015. Tone-Track: Leveraging Frequency-Agile Radios for Time-Based Indoor Wireless Localization. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking (MobiCom '15). ACM, New York, NY, USA, 537--549. Google ScholarDigital Library
- Moustafa Youssef and Ashok Agrawala. 2005. The Horus WLAN Location Determination System. In Proceedings of the 3rd International Conference on Mobile Systems, Applications, and Services (MobiSys '05). ACM, New York, NY, USA, 205--218. Google ScholarDigital Library
- Moustafa Youssef, Matthew Mah, and Ashok Agrawala. 2007. Challenges: Device-free Passive Localization for Wireless Environments. In Proceedings of the 13th Annual ACM International Conference on Mobile Computing and Networking (MobiCom '07). ACM, New York, NY, USA, 222--229. Google ScholarDigital Library
- Zhaoyuan Yu, Linwang Yuan, Wen Luo, Linyao Feng, and Guonian Lv. 2016. Spatio-Temporal Constrained Human Trajectory Generation from the PIR Motion Detector Sensor Network Data: A Geometric Algebra Approach. Sensors 16, 1 (2016).Google Scholar
- Fusang Zhang, Daqing Zhang, Jie Xiong, Hao Wang, Kai Niu, Beihong Jin, and Yuxiang Wang. 2018. From Fresnel Diffraction Model to Fine-grained Human Respiration Sensing with Commodity Wi-Fi Devices. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 1, Article 53 (March 2018), 23 pages. Google ScholarDigital Library
Index Terms
- Training-Free Human Vitality Monitoring Using Commodity Wi-Fi Devices
Recommendations
A Training-Free Contactless Human Vitality Monitoring Platform Using Commodity Wi-Fi Devices
UbiComp '18: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable ComputersHuman vitality information is pivotal to many sensing applications. By vitality, we mean the status of a human target in a multi-room environment: whether he/she is still and which room he/she is located in. Continuous monitoring of human vitality helps ...
Cross-assistive approach for PDR and Wi-Fi positioning
UbiComp '14 Adjunct: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct PublicationIn indoor positioning using Wi-Fi, there is a problem that the accuracy is not stable by the occurrence of large errors. Large errors tend to occur when density of wireless LAN access points is low or the radio wave condition is unstable. Furthermore, ...
A model based decimeter-scale device-free localization system using COTS wi-fi devices
UbiComp '17: Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable ComputersCommodity Wi-Fi based device-free localization has attracted a great attention in recent years. Previous related work is either fingerprint-based or model-based. In this demo, we will demonstrate a generic Fresnel Penetration Model (FPM) based real-time ...
Comments