Jarrod Knibbe
Paul Strohmeier
Sebastian Boring
Skip Abstract Section
Skip Supplemental Material SectionAbstract
Electric muscle stimulation (EMS) can enable mobile force feedback, support pedestrian navigation, or confer object affordances. To date, however, EMS is limited by two interlinked problems. (1) EMS is low resolution -- achieving only coarse movements and constraining opportunities for exploration. (2) EMS requires time consuming, expert calibration -- confining these interaction techniques to the lab. EMS arrays have been shown to increase stimulation resolution, but as calibration complexity increases exponentially as more electrodes are used, we require heuristics or automated procedures for successful calibration. We explore the feasibility of using electromyography (EMG) to auto-calibrate high density EMS arrays. We determine regions of muscle activity during human-performed gestures, to inform stimulation patterns for EMS-performed gestures. We report on a study which shows that auto-calibration of a 60-electrode array is feasible: achieving 52% accuracy across six gestures, with 82% accuracy across our best three gestures. By highlighting the electrode-array calibration problem, and presenting a first exploration of a potential solution, this work lays the foundations for high resolution, wearable and, perhaps one day, ubiquitous EMS beyond the lab.
Supplemental Material
Available for Download
zip
knibbe.zip (429.6 KB)
Supplemental movie, appendix, image and software files for, Automatic Calibration of High Density Electric Muscle Stimulation
- Christoph Amma, Thomas Krings, Jonas Böer, and Tanja Schultz. 2015. Advancing Muscle-Computer Interfaces with High-Density Electromyography. {In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI ’15), 929--938}. Google Scholar
Digital Library
- Christopher Assad, Michael Wolf, Theodoros Theodoridis, Kyrre Glette, and Adrian Stoica. 2013. BioSleeve: A Natural EMG-based Interface for HRI. {In Proceedings of the 8th ACM/IEEE International Conference on Human-robot Interaction (HRI ’13), 69--70}. Retrieved September 18, 2016 from http://dl.acm.org/citation.cfm?id=2447556.2447571 Google ScholarDigital Library
- Chad E. Bouton, Ammar Shaikhouni, Nicholas V. Annetta, Marcia A. Bockbrader, David A. Friedenberg, Dylan M. Nielson, Gaurav Sharma, Per B. Sederberg, Bradley C. Glenn, W. Jerry Mysiw, Austin G. Morgan, Milind Deogaonkar, and Ali R. Rezai. 2016. Restoring cortical control of functional movement in a human with quadriplegia. Nature 533, 7602: 247--250}.Google Scholar
- Shyang Chang, Ming-Chun Hsyu, Hsiu-Yao Cheng, Sheng-Hwu Hsieh, and Chen-Chiang Lin. 2008. Synergic Co-activation in Forearm Pronation. Annals of Biomedical Engineering 36, 12: 2002--2018}.Google ScholarCross Ref
- Cristiano De Marchis, Thiago Santos Monteiro, Cristina Simon-Martinez, Silvia Conforto, and Alireza Gharabaghi. 2016. Multicontact functional electrical stimulation for hand opening: electrophysiologically driven identification of the optimal stimulation site. Journal of NeuroEngineering and Rehabilitation 13}.Google Scholar
- Tim Duente, Max Pfeiffer, and Michael Rohs. 2016. On-skin Technologies for Muscle Sensing and Actuation. {In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp ’16), 933--936}. Google ScholarDigital Library
- C Frigo, M Ferrarin, W Frasson, E Pavan, and R Thorsen. 2000. EMG signals detection and processing for on-line control of functional electrical stimulation. Journal of Electromyography and Kinesiology 10, 5: 351--360}.Google ScholarCross Ref
- Marco Gazzoni, Nicolò Celadon, Davide Mastrapasqua, Marco Paleari, Valentina Margaria, and Paolo Ariano. 2014. Quantifying Forearm Muscle Activity during Wrist and Finger Movements by Means of Multi-Channel Electromyography. PLOS ONE 9, 10: e109943}.Google Scholar
- Manami Katoh, Narihiro Nishimura, Maki Yokoyama, Taku Hachisu, Michi Sato, Shogo Fukushima, and Hiroyuki Kajimoto. 2013. Optimal Selection of Electrodes for Muscle Electrical Stimulation Using Twitching Motion Measurement. {In Proceedings of the 4th Augmented Human International Conference (AH ’13), 237--238}. Google ScholarDigital Library
- Oliver Beren Kaul, Max Pfeiffer, and Michael Rohs. 2016. Follow the Force: Steering the Index Finger Towards Targets Using EMS. {In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA ’16), 2526--2532}. Google ScholarDigital Library
- T. Keller, M. Lawrence, A. Kuhn, and M. Morari. 2006. New Multi-Channel Transcutaneous Electrical Stimulation Technology for Rehabilitation. {In 28th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2006. EMBS ’06, 194--197}.Google Scholar
- Thierry Keller and Andreas Kuhn. 2008. Electrodes for transcutaneous (surface) electrical stimulation. Journal of Automatic Control 18, 2: 35--45}.Google ScholarCross Ref
- Andreas Kuhn, Thierry Keller, Silvestro Micera, and Manfred Morari. 2009. Array electrode design for transcutaneous electrical stimulation: a simulation study. Medical Engineering 8 Physics 31, 8: 945--951}.Google Scholar
- Pedro Lopes and Patrick Baudisch. 2013. Muscle-propelled Force Feedback: Bringing Force Feedback to Mobile Devices. {In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’13), 2577--2580}. Google ScholarDigital Library
- Pedro Lopes, Lars Butzmann, and Patrick Baudisch. 2013. Muscle-propelled Force Feedback: Bringing Force Feedback to Mobile Devices Using Electrical Stimulation. {In Proceedings of the 4th Augmented Human International Conference (AH ’13), 231--232}. Google ScholarDigital Library
- Pedro Lopes, Alexandra Ion, and Patrick Baudisch. 2015. Impacto: Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation. {In Proceedings of the 28th Annual ACM Symposium on User Interface Software 8 Technology (UIST ’15), 11--19}. Google ScholarDigital Library
- Pedro Lopes, Alexandra Ion, Willi Mueller, Daniel Hoffmann, Patrik Jonell, and Patrick Baudisch. 2015. Proprioceptive Interaction. {In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI ’15), 939--948}. Google ScholarDigital Library
- Pedro Lopes, Patrik Jonell, and Patrick Baudisch. 2015. Affordance++: Allowing Objects to Communicate Dynamic Use. {In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI ’15), 2515--2524}. Google ScholarDigital Library
- Pedro Lopes, Doăa Yüksel, François Guimbretière, and Patrick Baudisch. 2016. Muscle-plotter: An Interactive System Based on Electrical Muscle Stimulation That Produces Spatial Output. {In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST ’16), 207--217}. Google ScholarDigital Library
- Nebojša M. Malešević, Lana Z. Popović Maneski, Vojin Ilić, Nikola Jorgovanović, Goran Bijelić, Thierry Keller, and Dejan B. Popović. 2012. A multi-pad electrode based functional electrical stimulation system for restoration of grasp. Journal of NeuroEngineering and Rehabilitation 9: 66}.Google ScholarCross Ref
- Nebojsa Malesevic, Lana Popovic, Goran Bijelic, and Goran Kvascev. 2010. Muscle twitch responses for shaping the multi-pad electrode for functional electrical stimulation. Journal of Automatic Control 20: 53--58}.Google ScholarCross Ref
- S. Mathur, J. J. Eng, and D. L. MacIntyre. 2005. Reliability of surface EMG during sustained contractions of the quadriceps. Journal of Electromyography and Kinesiology 15, 1: 102--110}.Google ScholarCross Ref
- Jess McIntosh, Charlie McNeill, Mike Fraser, Frederic Kerber, Markus Löchtefeld, and Antonio Krüger. 2016. EMPress: Practical Hand Gesture Classification with Wrist-Mounted EMG and Pressure Sensing. {In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16), 2332--2342}. Google ScholarDigital Library
- Jeremy Mogk and Peter Keir. 2003. The effects of posture on forearm muscle loading during gripping. Ergonomics 46, 9: 956--975}.Google ScholarCross Ref
- Jun Nishida and Kenji Suzuki. 2016. bioSync: Synchronous Kinesthetic Experience Among People. {In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA ’16), 3742--3745}. Google ScholarDigital Library
- Max Pfeiffer, Tim Dünte, Stefan Schneegass, Florian Alt, and Michael Rohs. 2015. Cruise Control for Pedestrians: Controlling Walking Direction Using Electrical Muscle Stimulation. {In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI ’15), 2505--2514}. Google ScholarDigital Library
- Dejan B. Popović and Mirjana B. Popović. 2011. Advances in the use of electrical stimulation for the recovery of motor function. Progress in Brain Research 194: 215--225}.Google ScholarCross Ref
- Ana Popović-Bijelić, Goran Bijelić, Nikola Jorgovanović, Dubravka Bojanić, Mirjana B. Popović, and Dejan B. Popović. 2005. Multi-Field Surface Electrode for Selective Electrical Stimulation. Artificial Organs 29, 6: 448--452}.Google ScholarCross Ref
- Raafat Shalaby, Thomas Schauer, Wolfgang Liedecke, and Jörg Raisch. 2011. Amplifier design for EMG recording from stimulation electrodes during functional electrical stimulation leg cycling ergometry. Biomedizinische Technik. Biomedical Engineering 56, 1: 23--33}.Google ScholarCross Ref
- Didier Staudenmann, Jaap H. van Dieën, Dick F. Stegeman, and Roger M. Enoka. 2014. Increase in heterogeneity of biceps brachii activation during isometric submaximal fatiguing contractions: a multichannel surface EMG study. Journal of Neurophysiology 111, 5: 984--990}.Google ScholarCross Ref
- Didier Staudenmann, Dick F. Stegeman, and Jaap H. van Dieën. 2013. Redundancy or heterogeneity in the electric activity of the biceps brachii muscle? Added value of PCA-processed multi-channel EMG muscle activation estimates in a parallel-fibered muscle. Journal of Electromyography and Kinesiology: Official Journal of the International Society of Electrophysiological Kinesiology 23, 4: 892--898}.Google ScholarCross Ref
- Emi Tamaki, Terence Chan, and Ken Iwasaki. 2016. UnlimitedHand: Input and Output Hand Gestures with Less Calibration Time. {In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST ’16 Adjunct), 163--165}. Google ScholarDigital Library
- Emi Tamaki, Takashi Miyaki, and Jun Rekimoto. 2011. PossessedHand: Techniques for Controlling Human Hands Using Electrical Muscles Stimuli. {In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’11), 543--552}. Google ScholarDigital Library
- M. T. Wolf, C. Assad, A. Stoica, Kisung You, H. Jethani, M. T. Vernacchia, J. Fromm, and Y. Iwashita. 2013. Decoding static and dynamic arm and hand gestures from the JPL BioSleeve. {In 2013 IEEE Aerospace Conference, 1--9}.Google Scholar
- 1. The Flexors And Extensors Of The Fingers. Retrieved May 2, 2017 from http://chestofbooks.com/health/anatomy/Human-Body-Construction/1-The-Flexors-And-Extensors-Of-The-Fingers.htmlGoogle Scholar
Index Terms
- Automatic Calibration of High Density Electric Muscle Stimulation
Recommendations
Experiencing Electrical Muscle Stimulation
Electrical Muscle Stimulation (EMS) offers rich opportunities for interaction. By varying stimulation parameters (amplitudes, pulse widths and frequencies), EMS can be used to either trigger muscle contractions, and so convey object affordances or guide ...
Reducing Muscle Activity when Playing Tremolo by Using Electrical Muscle Stimulation
AHs '21: Proceedings of the Augmented Humans International Conference 2021When beginners play the piano, the activity of the forearm muscles tends to be greater than that of experts because beginners move their fingers with more force than necessary. Reducing forearm muscle activity is important for pianists to prevent ...
Multi-position Outfield Calibration for Laser Gyro Strapdown Inertial Navigation System
ICECC '12: Proceedings of the 2012 International Conference on Electronics, Communications and ControlIt is important to calibrate the errors of sensors to improve the performance level of laser gyro strap down inertial navigation system (SINS). In this paper, a calibration method that is suitable for practical application in the outfield is presented ...
Comments