Tessutivo: Contextual Interactions on Interactive Fabrics with Inductive Sensing

ABSTRACT

We present Tessutivo, a contact-based inductive sensing technique for contextual interactions on interactive fabrics. Our technique recognizes conductive objects (mainly metallic) that are commonly found in households and workplaces, such as keys, coins, and electronic devices. We built a prototype containing six by six spiral-shaped coils made of conductive thread, sewn onto a four-layer fabric structure. We carefully designed the coil shape parameters to maximize the sensitivity based on a new inductance approximation formula. Through a ten-participant study, we evaluated the performance of our proposed sensing technique across 27 common objects. We yielded 93.9% real-time accuracy for object recognition. We conclude by presenting several applications to demonstrate the unique interactions enabled by our technique.

References

1. TI LDC Sensor Design Application Report SNOA930. 2015. Retrieved March 15, 2019 from http://www.ti.com/lit/an/snoa930a/snoa930a.pdf
2. Eugen Berlin, Jun Liu, Kristof van Laerhoven and Bernt Schiele. 2010. Coming to grips with the objects we grasp: detecting interactions with efficient wrist-worn sensors. In Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction (TEI'10), 57--64. DOI=http://dx.doi.org/10.1145/1709886.1709898
3. Michael Boyle and Saul Greenberg. 2005. The language of privacy: Learning from video media space analysis and design. ACM Trans. Comput.-Hum. Interact., 12 (2). 328--370. DOI= http://dx.doi.org /10.1145/1067860.1067868
4. Leah Buechley and Michael Eisenberg. 2009. Fabric PCBs, electronic sequins, and socket buttons: techniques for e-textile craft. Personal Ubiquitous Comput., 13 (2). 133--150. DOI=https://doi.org/10.1007/s00779-007-0181-0
5. Michael Buettner, Richa Prasad, Matthai Philipose and David Wetherall. 2009. Recognizing daily activities with RFID-based sensors. In Proceedings of the 11th international conference on Ubiquitous computing (UbiComp'09), 51--60. DOI=http://doi.acm.org/10.1145/1620545.1620553
6. Perumal Varun Chadalavada, Goutham Palaniappan, Vimal Kumar Chandran, Khai Truong and Daniel Wigdor. 2018. ID'em: Inductive Sensing for Embedding and Extracting Information in Robust Materials. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2 (3). 1--28. DOI=https://doi.org/10.1145/3264907
7. Liwei Chan, Yi-Ling Chen, Chi-Hao Hsieh, Rong-Hao Liang and Bing-Yu Chen. 2015. CyclopsRing: Enabling Whole-Hand and Context-Aware Interactions Through a Fisheye Ring. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology, 549--556. DOI=https://doi.org/10.1145/2807442.2807450
8. Kai-Yin Cheng, Rong-Hao Liang, Bing-Yu Chen, Rung-Huei Laing and Sy-Yen Kuo. 2010. iCon: utilizing everyday objects as additional, auxiliary and instant tabletop controllers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'10), 1155--1164. DOI=https://doi.org/10.1145/1753326.1753499
9. Kunigunde Cherenack, Christoph Zysset, Thomas Kinkeldei, Niko Münzenrieder and Gerhard Tröster. 2010. Woven Electronic Fibers with Sensing and Display Functions for Smart Textiles. Advanced Materials, 22 (45). 5178--5182. DOI=https://doi.org/10.1002/adma.201002159
10. Lucy E. Dunne, Kaila Bibeau, Lucie Mulligan, Ashton Frith and Cory Simon. 2012. Multi-layer e-textile circuits. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp'12), 649--650. DOI=http://dx.doi.org/10.1145/2370216.2370348
11. Jun Gong, Xin Yang, Teddy Seyed, Josh Urban Davis and Xing-Dong Yang. 2018. Indutivo: Contact-Based, Object-Driven Interactions with Inductive Sensing. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST'18), 321--333. DOI=https://doi.org/10.1145/3242587.3242662
12. Tobias Grosse-Puppendahl, Sebastian Herber, Raphael Wimmer, Frank Englert, Sebastian Beck, Julian von Wilmsdorff, Reiner Wichert and Arjan Kuijper. 2014. Capacitive near-field communication for ubiquitous interaction and perception. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp'14), 231--242. DOI=https://doi.org/10.1145/2632048.2632053
13. Sunao Hashimoto, Ryohei Suzuki, Youichi Kamiyama, Masahiko Inami and Takeo Igarashi. 2013. LightCloth: senseable illuminating optical fiber cloth for creating interactive surfaces. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA'13), 2809--2810. DOI=https://doi.org/10.1145/2468356.2479523
14. Gerard J. Hayes, Ying Liu, Jan Genzer, Gianluca Lazzi and Michael D. Dickey. 2014. Self-Folding Origami Microstrip Antennas. IEEE Transactions on Antennas and Propagation, 62 (10). 5416--5419. DOI=https://doi.org/10.1109/TAP.2014.2346188
15. Steve Hodges, Alan Thorne, Hugo Mallinson and Christian Floerkemeier. 2007. Assessing and optimizing the range of UHF RFID to enable real-world pervasive computing applications. In International Conference on Pervasive Computing, 280--297. DOI=https://doi.org/10.1007/978--3--540--72037--9_17
16. David I Lehn, Craig W Neely, Kevin Schoonover, Thomas L Martin and Mark Jones. 2004. e-TAGs: e-textile attached gadgets. In Proceedings of the Communication Networks and Distributed Systems Modeling and Simulation Conference.
17. Hiren Galiyawala Kinjal H. Pandya. 2014. A Survey on QR Codes : in context of Research and Application. International Journal of Emerging Technology and Advanced Engineering. 4 (3). 258--262.
18. Gierad Laput, Robert Xiao and Chris Harrison. 2016. Viband: High-fidelity bio-acoustic sensing using commodity smartwatch accelerometers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST'16), 321--333. DOI=https://doi.org/10.1145/2984511.2984582
19. Gierad Laput, Chouchang Yang, Robert Xiao, Alanson Sample and Chris Harrison. 2015. Em-sense: Touch recognition of uninstrumented, electrical and electromechanical objects. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (UIST'15), 157--166. DOI=https://doi.org/10.1145/2807442.2807481
20. Joanne Leong, Patrick Parzer, Florian Perteneder, Teo Babic, Christian Rendl, Anita Vogl, Hubert Egger, Alex Olwal and Michael Haller. 2016. proCover: Sensory Augmentation of Prosthetic Limbs Using Smart Textile Covers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST'16), 335--346. DOI=https://doi.org/10.1145/2984511.2984572
21. Hanchuan Li, Eric Brockmeyer, Elizabeth J. Carter, Josh Fromm, Scott E. Hudson, Shwetak N. Patel and Alanson Sample. 2016. PaperID: A Technique for Drawing Functional Battery-Free Wireless Interfaces on Paper. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 5885--5896. DOI=https://doi.org/10.1145/2858036.2858249
22. Hanchuan Li, Can Ye and Alanson P. Sample. 2015. IDSense: A Human Object Interaction Detection System Based on Passive UHF RFID. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI'15), 2555--2564. DOI=https://doi.org/10.1145/2702123.2702178
23. Jaime Lien, Nicholas Gillian, M. Emre Karagozler, Patrick Amihood, Carsten Schwesig, Erik Olson, Hakim Raja and Ivan Poupyrev. 2016. Soli: Ubiquitous Gesture Sensing with Millimeter Wave Radar. In ACM Transactions on Graphics (SIGGRAPH'16). DOI=https://doi.org/10.1145/2897824.2925953
24. David G. Lowe. 1999. Object recognition from local scale-invariant features. In Proceedings of the Seventh IEEE International Conference on Computer Vision (ICCV'99), 1150--1157. DOI=https://doi.org/10.1109/ICCV.1999.790410
25. Takuya Maekawa, Yasue Kishino, Yutaka Yanagisawa and Yasushi Sakurai. 2012. Recognizing handheld electrical device usage with hand-worn coil of wire. In International Conference on Pervasive Computing (Pervasive'12), 234--252. DOI=https://doi.org/10.1007/978--3--642--31205--2_15
26. Jan Meyer, Bert Arnrich, Johannes Schumm and Gerhard Troster. 2010. Design and Modeling of a Textile Pressure Sensor for Sitting Posture Classification. IEEE Sensors Journal, 10 (8). 1391--1398. DOI=https://doi.org/10.1109/JSEN.2009.2037330
27. Norhisam Misron, Loo Qian Ying, Raja Nor Firdaus, Norrimah Abdullah, Nashiren Farzilah Mailah and Hiroyuki Wakiwaka. 2011. Effect of inductive coil shape on sensing performance of linear displacement sensor using thin inductive coil and pattern guide. Sensors, 11 (11). 10522--10533. DOI=https://doi.org/10.3390/s111110522
28. Sunderarajan S Mohan, Maria del Mar Hershenson, Stephen P Boyd and Thomas H Lee. 1999. Simple accurate expressions for planar spiral inductances. IEEE Journal of solid-state circuits, 34 (10). 1419--1424. DOI=https://doi.org/10.1109/4.792620
29. David S. Nyce. Inductive Sensing. In Linear Position Sensors. 78--93. DOI=https://doi.org/10.1002/0471474282
30. Patrick Parzer, Florian Perteneder, Kathrin Probst, Christian Rendl, Joanne Leong, Sarah Schuetz, Anita Vogl, Reinhard Schwoediauer, Martin Kaltenbrunner, Siegfried Bauer and Michael Haller. 2018. RESi: A Highly Flexible, Pressure-Sensitive, Imperceptible Textile Interface Based on Resistive Yarns. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST'18), 745--756. DOI=https://doi.org/10.1145/3242587.3242664
31. Patrick Parzer, Kathrin Probst, Teo Babic, Christian Rendl, Anita Vogl, Alex Olwal and Michael Haller. 2016. FlexTiles: A Flexible, Stretchable, Formable, Pressure-Sensitive, Tactile Input Sensor. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA'16), 3754--3757. DOI=https://doi.org/10.1145/2851581.2890253
32. Patrick Parzer, Adwait Sharma, Anita Vogl, Jurgen Steimle, Alex Olwal and Michael Haller. 2017. SmartSleeve: Real-time Sensing of Surface and Deformation Gestures on Flexible, Interactive Textiles, using a Hybrid Gesture Detection Pipeline. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST'17), 565--577. DOI=https://doi.org/10.1145/3126594.3126652
33. Vesa Peltonen, Juha Tuomi, Anssi Klapuri, Jyri Huopaniemi and Timo Sorsa. 2002. Computational auditory scene recognition. In IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP'02), II-1941-II-1944. DOI=https://doi.org/10.1109/ICASSP.2002.5745009
34. Alex "Sandy" Pentland. 1998. Wearable Intelligence. Scientific American, 90--95.
35. Ivan Poupyrev, Nan-Wei Gong, Shiho Fukuhara, Mustafa Emre Karagozler, Carsten Schwesig and Karen E. Robinson. 2016. Project Jacquard: Interactive Digital Textiles at Scale. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 4216--4227. DOI=https://doi.org/10.1145/2858036.2858176
36. Juhi Ranjan, Yu Yao, Erin Griffiths and Kamin Whitehouse. 2012. Using mid-range RFID for location based activity recognition. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp'12), 647--648. DOI=http://dx.doi.org/10.1145/2370216.2370347
37. Mahsan Rofouei, Wenyao Xu and Majid Sarrafzadeh. 2010. Computing with uncertainty in a smart textile surface for object recognition. In 2010 IEEE Conference on Multisensor Fusion and Integration, 174--179. DOI=http://dx.doi.org/10.1109/MFI.2010.5604473
38. Edward B. Rosa. 1906. Calculation of the self-inductances of single-layer coils. Bull. Bureau Standards, 2 (2). 161--187.
39. Edward Bennett Rosa. 1908. The self and mutual inductances of linear conductors.
40. Stefan Schneegass and Alexandra Voit. 2016. GestureSleeve: using touch sensitive fabrics for gestural input on the forearm for controlling smartwatches. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (ISWC '16), 108--115. DOI=https://doi.org/10.1145/2971763.2971797
41. Jamie Shotton, Andrew Fitzgibbon, Mat Cook, Toby Sharp, Mark Finocchio, Richard Moore, Alex Kipman and Andrew Blake. 2011. Real-time human pose recognition in parts from single depth images. In Conference on Computer Vision and Pattern Recognition (CVPR'11), 1297--1304. DOI=https://doi.org/10.1109/CVPR.2011.5995316
42. Joshua R Smith, Kenneth P Fishkin, Bing Jiang, Alexander Mamishev, Matthai Philipose, Adam D Rea, Sumit Roy and Kishore Sundara-Rajan. 2005. RFID-based techniques for human-activity detection. Communications of the ACM, 48 (9). 39--44. DOI=http://dx.doi.org/10.1145/1081992.1082018
43. Jie Song, Gábor Sörös, Fabrizio Pece, Sean Ryan Fanello, Shahram Izadi, Cem Keskin, and Otmar Hilliges. 2014. In-air gestures around unmodified mobile devices. In Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST '14), 319--329. DOI=https://doi.org/10.1145/2642918.2647373
44. Michael E. Van Steenberg, Andrew Washabaugh, and Neil Goldfme. 2001. Inductive and capacitive sensor arrays for in situ composition sensors. In Proceedings of 2001 IEEE Aerospace Conference. DOI=https://doi.org/10.1109/AERO.2001.931721
45. Yuta Sugiura, Gota Kakehi, Anusha Withana, Calista Lee, Daisuke Sakamoto, Maki Sugimoto, Masahiko Inami and Takeo Igarashi. 2011. Detecting shape deformation of soft objects using directional photoreflectivity measurement. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST'11), 509--516. DOI=https://doi.org/10.1145/2047196.2047263
46. Nalika Ulapane, Linh Nguyen, Jaime Valls Miro, Alen Alempijevic and Gamini Dissanayake. 2017. Designing a pulsed eddy current sensing set-up for cast iron thickness assessment. In 12th IEEE Conference on Industrial Electronics and Applications (ICIEA'17), 901--906. DOI=https://doi.org/10.1109/ICIEA.2017.8282967
47. Nicolas Villar, Daniel Cletheroe, Greg Saul, Christian Holz, Tim Regan, Oscar Salandin, Misha Sra, Hui- Shyong Yeo, William Field and Haiyan Zhang. 2018. Project Zanzibar: A Portable and Flexible Tangible Interaction Platform. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. DOI=https://doi.org/10.1145/3173574.3174089
48. Anita Vogl, Patrick Parzer, Teo Babic, Joanne Leong, Alex Olwal and Michael Haller. 2017. StretchEBand: Enabling Fabric-based Interactions through Rapid Fabrication of Textile Stretch Sensors. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17), 2617--2627. DOI=https://doi.org/10.1145/3025453.3025938
49. Edward J Wang, Tien-Jui Lee, Alex Mariakakis, Mayank Goel, Sidhant Gupta and Shwetak N Patel. 2015. Magnifisense: Inferring device interaction using wrist-worn passive magneto-inductive sensors. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp'15), 15--26. DOI=https://doi.org/10.1145/2750858.2804271
50. Jamie A Ward, Paul Lukowicz, Gerhard Troster and Thad E Starner. 2006. Activity recognition of assembly tasks using body-worn microphones and accelerometers. IEEE transactions on pattern analysis and machine intelligence, 28 (10). 1553--1567. DOI=https://doi.org/10.1109/TPAMI.2006.197
51. Robert Xiao, Gierad Laput, Yang Zhang and Chris Harrison. 2017. Deus EM Machina: on-touch contextual functionality for smart IoT appliances. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17), 4000--4008. DOI=https://doi.org/10.1145/3025453.3025828
52. Wenyao Xu, Ming-Chun Huang, Navid Amini, Lei He and Majid Sarrafzadeh. 2013. eCushion: A Textile Pressure Sensor Array Design and Calibration for Sitting Posture Analysis. IEEE Sensors Journal, 13 (10), 3926--3934. DOI=https://doi.org/10.1109/JSEN.2013.2259589
53. Hui-Shyong Yeo, Gergely Flamich, Patrick Schrempf, David Harris-Birtill and Aaron Quigley. 2016. Radarcat: Radar categorization for input and interaction. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST'16), 833--841. DOI=https://doi.org/10.1145/2984511.2984515
54. Jonsenser Zhao. 2010. A new calculation for designing multilayer planar spiral inductors. EDN (Electrical Design News), 55 (14), 37.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)