Inertial motion capture based reference trajectory generation for a mobile manipulator

ABSTRACT

This paper presents a human-robot interaction system integrating a mobile manipulator with a full-body inertial motion capture suit. The framework aims to provide an intuitive, effective and easy-to-deploy teleoperation interface. User control intent is acquired by the motion capture system in real-time, processed and relayed to the mobile manipulator wirelessly. Specifically, body center of mass and the right hand kinematic data of the user are used to generate position and orientation references for the robot base and manipulator, respectively. The left arm is employed to provide high-level user commands such as "Manipulator On/Off", "Base On/Off" and "Manipulator Pause/Resume". The efficacy of the presented system was demonstrated in real-time teleoperation experiments using KUKA youBot mobile manipulator accomplishing pick-and-place tasks.

References

1. Cho, S. K., Jin, H. Z., Lee, J. M., and Yao, B. Teleoperation of a mobile robot using a force-reflection joystick with sensing mechanism of rotating magnetic field. IEEE/ASME Transactions on Mechatronics 15, 1 (February), 17--26. DOI= http://dx.doi.org/10.1109/TMECH.2009.2013848.
2. Ding, C. J., Duan, P., Zhang, M. L., and Zhang, Y. F. Design of mobile robot teleoperation system based on virtual reality. In IEEE International Conference on Automation and Logistics, Shenyang, 2023--2028. DOI= http://dx.doi.org/10.1109/ICAL.2009.5262601.
3. Fukuda, O., Tsuji, T., Kaneko, M., and Otsuka, A. A human-assisting manipulator teleoperated by EMG signals and arm motions. IEEE Transactions on Robotics and Automation 19, 2 (April), 210--222. DOI= http://dx.doi.org/10.1109/TRA.2003.808873.
4. Hu, C., Meng, M. Q., Liu, P. X. P., and Wang, X. Visual gesture recognition for human-machine interface of robot teleoperation. In Proceedings of the 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems, 1560--1565. DOI= http://dx.doi.org/10.1109/IROS.2003.1248866.
5. Kofman, J., Wu, X. H., Luu, T. J., and Verma, S. Teleoperation of a robot manipulator using a vision-based human-robot interface. IEEE Transactions on Industrial Electronics 52, 5 (October), 1206--1219. DOI= http://dx.doi.org/10.1109/TIE.2005.855696.
6. Rosen, J. and Perry, J. C. Upper limb powered exoskeleton design. IEEE/ASME Transactions on Mechatronics 12, 4 (August 20), 408--417. DOI= http://dx.doi.org/10.1109/TMECH.2007.901934.
7. Song, W. B., Guo, X. J., Jiang, F. J., Yang, S., Jiang, G. X., and Shi, Y. F. Teleoperation humanoid robot control system based on Kinect sensor. In International Conference on Intelligent Human-Machine Systems and Cybernetics, Nanchang, Jiangxi, 264--267. DOI= http://dx.doi.org/10.1109/IHMSC.2012.159.

Index Terms

• Computer systems organization

  • Embedded and cyber-physical systems

    • Robotics

      • External interfaces for robotics

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction paradigms