Nan Yu
Skip Abstract Section
Abstract
Many HCI applications, such as volume adjustment in a gaming system, require quantitative gesture measurement for metrics such as movement distance and direction. In this paper, we propose QGesture, a gesture recognition system that uses CSI values provided by COTS WiFi devices to measure the movement distance and direction of human hands. To achieve high accuracy in measurements, we first use phase correction algorithm to remove the phase noise in CSI measurements. We then propose a robust estimation algorithm, called LEVD, to estimate and remove the impact of environmental dynamics. To separate gesture movements from daily activities, we design simple gestures with unique characteristics as preambles to determine the start of the gesture. Our experimental results show that QGesture achieves an average accuracy of 3 cm in the measurement of movement distance and more than 95% accuracy in the movement direction detection in the one-dimensional case. Furthermore, it achieves an average absolute direction error of 15 degrees and an average accuracy of 3.7 cm in the measurement of movement distance in the two-dimensional case.
- Heba Abdelnasser, Moustafa Youssef, and Khaled A Harras. 2015. WiGest: A Ubiquitous WiFi-based Gesture Recognition System. In Proceedings of IEEE INFOCOM.Google Scholar
Cross Ref
- Fadel Adib, Zachary Kabelac, and Dina Katabi. 2015. Multi-Person Motion Tracking via RF Body Reflections. In Proceedings of Usenix NSDI. Google ScholarDigital Library
- Fadel Adib, Zach Kabelac, Dina Katabi, and Robert C Miller. 2013. 3D Tracking via Body Radio Reflections. In Proceedings of Usenix NSDI. Google ScholarDigital Library
- Jake K. Aggarwal and S. Ryoo Michael. 2011. Human activity analysis: A review. Comput. Surveys 43, 3 (2011). Google ScholarDigital Library
- Mohammed Abdulaziz Aide Al-qaness and Fangmin Li. 2016. WiGeR: WiFi-based gesture recognition system. ISPRS International Journal of Geo-Information 5, 6 (2016), 92.Google ScholarCross Ref
- Kamran Ali, Alex X. Liu, Wei Wang, and Muhammad Shahzad. 2015. Keystroke Recognition Using WiFi Signals. In ACM MobiCom. Google ScholarDigital Library
- Xiaoxiao Cao, Bing Chen, and Yanchao Zhao. 2016. Wi-Wri: Fine-Grained Writing Recognition Using Wi-Fi Signals. In Proceedings of IEEE Trustcom/BigDataSE/ISPA.Google ScholarCross Ref
- Bo Chen, Vivek Yenamandra, and Kannan Srinivasan. 2015. Tracking Keystrokes Using Wireless Signals. In Proceedings of ACM MobiSys. Google ScholarDigital Library
- Han Ding, Chen Qian, Jinsong Han, Ge Wang, Wei Xi, Kun Zhao, and Jizhong Zhao. 2017. RFIPad: Enabling Cost-Efficient and Device-Free In-air Handwriting Using Passive Tags. In Proceedings of IEEE ICDCS.Google ScholarCross Ref
- Emre Ertin, Nathan Stohs, Santosh Kumar, Andrew Raij, Mustafa al'Absi, and Siddharth Shah. 2011. AutoSense: Unobtrusively Wearable Sensor Suite for Inferring the Onset, Causality, and Consequences of Stress in the Field. In Proceedings of ACM Sensys. Google ScholarDigital Library
- Sidhant Gupta, Daniel Morris, Shwetak Patel, and Desney Tan. 2012. Soundwave: Using the Doppler Effect to Sense Gestures. In Proceedings of ACM CHI. Google ScholarDigital Library
- Daniel Halperin, Wenjun Hu, Anmol Sheth, and David Wetherall. 2011. Tool Release: Gathering 802.11n Traces with Channel State Information. ACM SIGCOMM CCR 41, 1 (2011), 53. Google ScholarDigital Library
- Wenfeng He, Kaishun Wu, Yongpan Zou, and Zhong Ming. 2015. Wig: WiFi-based Gesture Recognition System. In Proceedings of IEEE ICCCN.Google ScholarCross Ref
- Kiran Joshi, Dinesh Bharadia, Manikanta Kotaru, and Sachin Katti. 2015. WiDeo: Fine-grained Device-free Motion Tracing using RF Backscatter. In Proceedings of Usenix NSDI. Google ScholarDigital Library
- Bryce Kellogg, Vamsi Talla, and Shyamnath Gollakota. 2014. Bringing Gesture Recognition to All Devices. In Proceedings of Usenix NSDI. Google ScholarDigital Library
- Kourosh Khoshelham. 2011. Accuracy analysis of kinect depth data. In Proceedings of ISPRS workshop Laser Scanning.Google Scholar
- Manikanta Kotaru, Kiran Joshi, Dinesh Bharadia, and Sachin Katti. 2015. SpotFi: Decimeter Level Localization using WiFi. In Proceedings of ACM SIGCOMM. Google ScholarDigital Library
- Hong Li, Wei Yang, Jianxin Wang, Yang Xu, and Liusheng Huang. 2016. WiFinger: Talk to Your Smart Devices with Finger-grained Gesture. In Proceedings of ACM UbiComp. Google ScholarDigital Library
- Jaime Lien, Nicholas Gillian, M Emre Karagozler, Patrick Amihood, Carsten Schwesig, Erik Olson, Hakim Raja, and Ivan Poupyrev. 2016. Soli: ubiquitous gesture sensing with millimeter wave radar. ACM Transactions on Graphics 35, 4 (2016), 142. Google ScholarDigital Library
- Jian Liu, Yan Wang, Yingying Chen, Jie Yang, Xu Chen, and Jerry Cheng. 2015. Tracking Vital Signs During Sleep Leveraging Off-the-shelf WiFi. In Proceedings of ACM Mobihoc. Google ScholarDigital Library
- Rajalakshmi Nandakumar, Vikram Iyer, Desney Tan, and Shyamnath Gollakota. 2016. FingerIO: Using Active Sonar for Fine-Grained Finger Tracking. In Proceedings of ACM CHI. Google ScholarDigital Library
- Rajalakshmi Nandakumar, Bryce Kellogg, and Shyamnath Gollakota. 2014. Wi-Fi Gesture Recognition on Existing Devices. arXiv preprint arXiv:1411.5394. (2014).Google Scholar
- Chunyi Peng, Guobin Shen, Yongguang Zhang, Yanlin Li, and Kun Tan. 2007. Beepbeep: a High Accuracy Acoustic Ranging System using COTS Mobile Devices. In Proceedings of ACM SenSys. Google ScholarDigital Library
- Qifan Pu, Sidhant Gupta, Shyamnath Gollakota, and Shwetak Patel. 2013. Whole-home Gesture Recognition Using Wireless Signals. In Proceedings of ACM MobiCom. Google ScholarDigital Library
- Li Sun, Souvik Sen, Dimitrios Koutsonikolas, and Kyu-Han Kim. 2015. WiDraw: Enabling Hands-free Drawing in the Air on Commodity WiFi Devices. In Proceedings of ACM MobiCom. Google ScholarDigital Library
- Sheng Tan and Jie Yang. 2016. WiFinger: Leveraging Commodity WiFi for Fine-grained Finger Gesture Recognition. In Proceedings of ACM Mobihoc. Google ScholarDigital Library
- Deepak Vasisht, Swarun Kumar, and Dina Katabi. 2016. Decimeter-level localization with a single WiFi access point. In Proceedings of USENIX NSDI. Google ScholarDigital Library
- Jue Wang, Deepak Vasisht, and Dina Katabi. 2014. RF-IDraw: Virtual Touch Screen in the Air Using RF Signals. In Proceedings of ACM SIGCOMM. Google ScholarDigital Library
- Wei Wang, Alex X. Liu, Muhammad Shahzad, Kang Ling, and Sanglu Lu. 2015. Understanding and Modeling of WiFi Signal Based Human Activity Recognition. In Proceedings of ACM MobiCom. Google ScholarDigital Library
- Wei Wang, Alex X. Liu, and Ke Sun. 2016. Device-Free Gesture Tracking Using Acoustic Signals. In Proceedings of ACM MobiCom. Google ScholarDigital Library
- Teng Wei and Xinyu Zhang. 2015. mTrack: High-Precision Passive Tracking Using Millimeter Wave Radios. In Proceedings of ACM MobiCom. Google ScholarDigital Library
- Frank Weichert, Daniel Bachmann, Bartholomäus Rudak, and Denis Fisseler. 2013. Analysis of the Accuracy and Robustness of the Leap Motion Controller. Sensors 13, 5 (2013), 6380--6393.Google ScholarCross Ref
- Dan Wu, Daqing Zhang, Chenren Xu, Yasha Wang, and Hao Wang. 2016. WiDir: Walking Direction Estimation Using Wireless Signals. In Proceedings of ACM UbiComp. Google ScholarDigital Library
- Yaxiong Xie, Zhenjiang Li, and Mo Li. 2015. Precise Power Delay Profiling with Commodity WiFi. In Proceedings of ACM MobiCom. Google ScholarDigital Library
- Lei Yang, Qiongzheng Lin, Xiangyang Li, Tianci Liu, and Yunhao Liu. 2015. See Through Walls with COTS RFID System!. In Proceedings of ACM MobiCom. Google ScholarDigital Library
- Koji Yatani and Khai N Truong. 2012. Bodyscope: a Wearable Acoustic Sensor for Activity Recognition. In Proceedings of ACM UbiComp. 341--350. Google ScholarDigital Library
- Moustafa Youssef, Matthew Mah, and Ashok Agrawala. 2007. Challenges: device-free passive localization for wireless environments. In ACM MobiCom. Google ScholarDigital Library
- Sangki Yun, Yi-Chao Chen, and Lili Qiu. 2015. Turning a Mobile Device into a Mouse in the Air. In Proceedings of ACM MobiSys. Google ScholarDigital Library
- Zengbin Zhang, David Chu, Xiaomeng Chen, and Thomas Moscibroda. 2012. Swordfight: Enabling a New Class of Phone-to-phone Action Games on Commodity Phones. In Proceedings of ACM MobiSys. Google ScholarDigital Library
Index Terms
- QGesture: Quantifying Gesture Distance and Direction with WiFi Signals
Recommendations
Mudra: User-friendly Fine-grained Gesture Recognition using WiFi Signals
CoNEXT '16: Proceedings of the 12th International on Conference on emerging Networking EXperiments and TechnologiesThere has been a great interest in recognizing gestures using wireless communication signals. We are motivated in detecting extremely fine, subtle finger gestures with WiFi signals. We envision this technology to find applications in finger-gesture ...
Construct 3D Hand Skeleton with Commercial WiFi
SenSys '23: Proceedings of the 21st ACM Conference on Embedded Networked Sensor SystemsThis paper presents HandFi, which constructs hand skeletons with practical WiFi devices. Unlike previous WiFi hand sensing systems that primarily employ predefined gestures for pattern matching, by constructing the hand skeleton, HandFi can enable a ...
A Method to Recognize Eyeball Movement Gesture using Infrared Distance Sensor Array on Eyewear
iiWAS2021: The 23rd International Conference on Information Integration and Web IntelligenceSensing technology for eyeball movement (i.e., gaze movement) has enabled various applications, e.g., hands-free input interfaces and provided information that helps us understand human beings in various fields. However, the existing method, which ...
Comments