Zero-Effort Camera-Assisted Calibration Techniques for Wearable Motion Sensors

ABSTRACT

Activity recognition using wearable motion sensors plays an important role in pervasive wellness and healthcare monitoring applications. The activity recognition algorithms are often designed to work with a known orientation of sensors on the body. In the case of accidental displacement of the motion sensors, it is important to identify the new sensor location and orientation. This step, often called calibration or recalibration, requires extra effort from the user to either perform a set of known movements, or enter information about the placement of the sensors manually. In this paper, we propose a camera-assisted calibration approach that does not require any extra effort from the user. The calibration is done seamlessly when the user appears in front of the camera (in our case, a Kinect camera) and performs an arbitrary activity of choice (e.g., walking in front of the camera). We provide experimental results supporting the effectiveness of our approach.

References

1. S. Mitchell, J. Collin, C. De Luca, A. Burrows, and L. Lipsitz, "Open-loop and closed-loop postural control mechanisms in parkinson's disease: increased mediolateral activity during quiet standing," Neuroscience letters, vol. 197, no. 2, pp. 133--136, 1995.
2. J. Pansiot, D. Stoyanov, D. McIlwraith, B. P. Lo, and G.-Z. Yang, "Ambient and wearable sensor fusion for activity recognition in healthcare monitoring systems," in 4th international workshop on wearable and implantable body sensor networks (BSN 2007), pp. 208--212, Springer, 2007.
3. U. Steinhoff and B. Schiele, "Dead reckoning from the pocket-an experimental study," in Pervasive Computing and Communications (PerCom), 2010 IEEE International Conference on, pp. 162--170, IEEE, 2010.
4. R. Chavarriaga, H. Bayati, and J. D. Millán, "Unsupervised adaptation for acceleration-based activity recognition: robustness to sensor displacement and rotation," Personal and Ubiquitous Computing, vol. 17, no. 3, pp. 479--490, 2013.
5. A. Henpraserttae, S. Thiemjarus, and S. Marukatat, "Accurate activity recognition using a mobile phone regardless of device orientation and location," in Body Sensor Networks (BSN), 2011 International Conference on, pp. 41--46, IEEE, 2011.
6. N. Kale, J. Lee, R. Lotfian, and R. Jafari, "Impact of sensor misplacement on dynamic time warping based human activity recognition using wearable computers," in Proceedings of the conference on Wireless Health, p. 7, ACM, 2012.
7. K. Kunze and P. Lukowicz, "Dealing with sensor displacement in motion-based onbody activity recognition systems," in Proceedings of the 10th international conference on Ubiquitous computing, pp. 20--29, ACM, 2008.
8. K. Forster, D. Roggen, and G. Troster, "Unsupervised classifier self-calibration through repeated context occurences: is there robustness against sensor displacement to gain?," in Wearable Computers, 2009. ISWC'09. International Symposium on, pp. 77--84, IEEE, 2009.
9. K. Kunze, P. Lukowicz, H. Junker, and G. Tröster, "Where am i: Recognizing on-body positions of wearable sensors," in Location-and Context-Awareness, pp. 264--275, Springer, 2005.
10. K. Kunze, P. Lukowicz, K. Partridge, and B. Begole, "Which way am i facing: Inferring horizontal device orientation from an accelerometer signal," in Wearable Computers, 2009. ISWC'09. International Symposium on, pp. 149--150, IEEE, 2009.
11. S. O. Madgwick, A. J. Harrison, and R. Vaidyanathan, "Estimation of imu and marg orientation using a gradient descent algorithm," in Rehabilitation Robotics (ICORR), 2011 IEEE International Conference on, pp. 1--7, IEEE, 2011.
12. J. J. Kuffner, "Effective sampling and distance metrics for 3d rigid body path planning," in Robotics and Automation, 2004. Proceedings. ICRA'04. 2004 IEEE International Conference on, vol. 4, pp. 3993--3998, IEEE, 2004.
13. D. Q. Huynh, "Metrics for 3d rotations: Comparison and analysis," Journal of Mathematical Imaging and Vision, vol. 35, no. 2, pp. 155--164, 2009

Index Terms

• Information systems

  • Information systems applications