Drill Sergeant: Supporting Physical Construction Projects through an Ecosystem of Augmented Tools

ABSTRACT

Mapping techniques from software tutorials onto physical craft processes can assist novices in building multi-material assemblies. By providing in-situ step instructions and progress tracking, generating dynamic feedback on technique, and adapting tutorial content to a user's specific context and preferences, an ecosystem of smart tools can guide users through complete project tutorials. We demonstrate how such techniques can be enabled by augmenting common workshop tools (drill/driver, saw, router) with measurement, state sensing and interactive feedback; and by sequencing instructions across multiple tools. We validate the benefits of a smart tool ecosystem through reflections on a series of author-created design examples and informal feedback from four fab lab users.

References

1. Stavros Antifakos, Florian Michahelles, and Bernt Schiele. 2002. Proactive Instructions for Furniture Assembly. In Proceedings of the 4th International Conference on Ubiquitous Computing. Springer-Verlag, London, UK, UK, 351-360. http://dl.acm.org/citation.cfm?id=647988.741481
2. Autodesk Inc. 2015. Instructables. http://instructables.com. (2015).
3. Lawrence Bergman, Vittorio Castelli, Tessa Lau, and Daniel Oblinger. 2005. DocWizards: A System for Authoring Follow-me Documentation Wizards. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST '05). ACM, New York, NY, USA, 191-200. DOI: http://dx.doi.org/10.1145/1095034.1095067
4. Floraine Berthouzoz, Wilmot Li, Mira Dontcheva, and Maneesh Agrawala. 2011. A Framework for Content-adaptive Photo Manipulation Macros: Application to Face, Landscape, and Global Manipulations. ACM Trans. Graph. 30, 5, Article 120 (Oct. 2011), 14 pages. DOI: http://dx.doi.org/10.1145/2019627.2019639
5. Ankit Gupta, Dieter Fox, Brian Curless, and Michael Cohen. 2012. DuploTrack: A Real-time System for Authoring and Guiding Duplo Block Assembly. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 389-402. DOI: http://dx.doi.org/10.1145/2380116.2380167
6. Clare J. Hooper, Anne Preston, Madeline Balaam, Paul Seedhouse, Daniel Jackson, Cuong Pham, Cassim Ladha, Karim Ladha, Thomas Plötz, and Patrick Olivier. 2012. The French Kitchen: Task-based Learning in an Instrumented Kitchen. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp '12). ACM, New York, NY, USA, 193-202. DOI: http://dx.doi.org/10.1145/2370216.2370246
7. Wendy Ju, Rebecca Hurwitz, Tilke Judd, and Bonny Lee. CounterActive: An Interactive Cookbook for the Kitchen Counter (CHI EA '01). ACM, 269-270. DOI: http://dx.doi.org/10.1145/634067.634227
8. Jarrod Knibbe, Tovi Grossman, and George Fitzmaurice. 2015. Smart Makerspace: An Immersive Instructional Space for Physical Tasks. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS '15). ACM, New York, NY, USA, 83-92. DOI: http://dx.doi.org/10.1145/2817721.2817741
9. Wei Li, Tovi Grossman, and George Fitzmaurice. 2012. GamiCAD: A Gamified Tutorial System for First Time Autocad Users. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 103-112. DOI: http://dx.doi.org/10.1145/2380116.2380131
10. John Nelson and Joyce Nelson. 2005. The Big Book of Weekend Woodworking: 150 Easy Projects. Lark Crafts.
11. Ohan Oda, Carmine Elvezio, Mengu Sukan, Steve Feiner, and Barbara Tversky. Virtual Replicas for Remote Assistance in Virtual and Augmented Reality (UIST '15). To appear.
12. Alec Rivers, Andrew Adams, and Frédo Durand. 2012a. Sculpting by Numbers. ACM Trans. Graph. 31, 6, Article 157 (Nov. 2012), 7 pages. DOI: http://dx.doi.org/10.1145/2366145.2366176
13. Alec Rivers, Ilan E. Moyer, and Frédo Durand. 2012b. Position-correcting Tools for 2D Digital Fabrication. ACM Trans. Graph. 31, 4, Article 88 (July 2012), 7 pages. DOI: http://dx.doi.org/10.1145/2185520.2185584
14. Ayaka Sato, Keita Watanabe, and Jun Rekimoto. 2013. MimiCook: A Cooking Assistant System with Situated Guidance. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI '14). ACM, New York, NY, USA, 121-124. DOI: http://dx.doi.org/10.1145/2540930.2540952
15. Phillip Schmidt. 2012. PlyDesign: 73 Distinctive DIY Projects in Plywood. Storey Publishing.
16. Elliot Soloway, Mark Guzdial, and Kenneth E. Hay. 1994. Learner-centered Design: The Challenge for HCI in the 21st Century. interactions 1, 2 (April 1994), 36-48. DOI: http://dx.doi.org/10.1145/174809.174813
17. Cristen Torrey, Elizabeth F. Churchill, and David W. McDonald. 2009. Learning How: The Search for Craft Knowledge on the Internet. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1371-1380. DOI: http://dx.doi.org/10.1145/1518701.1518908
18. Christian Weichel, Jason Alexander, Abhijit Karnik, and Hans Gellersen. SPATA: Spatio-Tangible Tools for Fabrication-Aware Design (TEI '15). ACM, 189-196. DOI: http://dx.doi.org/10.1145/2677199.2680576
19. Christian Weichel, Manfred Lau, David Kim, Nicolas Villar, and Hans W. Gellersen. MixFab: A Mixed-reality Environment for Personal Fabrication (CHI '14). ACM, 3855-3864. DOI: http://dx.doi.org/10.1145/2556288.2557090
20. Wikipedia. 2015. Camera Resectioning. https://en.wikipedia.org/wiki/Camera_resectioning. (2015).
21. Karl D.D. Willis, Cheng Xu, Kuan-Ju Wu, Golan Levin, and Mark D. Gross. Interactive Fabrication: New Interfaces for Digital Fabrication (TEI '11). ACM, 69-72. DOI: http://dx.doi.org/10.1145/1935701.1935716
22. A. Zoran, R. Shilkrot, P. Goyal, P. Maes, and J.A. Paradiso. 2014a. The Wise Chisel: The Rise of the Smart Handheld Tool. Pervasive Computing, IEEE 13, 3 (July 2014), 48-57. DOI: http://dx.doi.org/10.1109/MPRV.2014.59
23. Amit Zoran, Roy Shilkrot, Suranga Nanyakkara, and Joseph Paradiso. 2014b. The Hybrid Artisans: A Case Study in Smart Tools. ACM Trans. Comput.-Hum. Interact. 21, 3, Article 15 (June 2014), 29 pages. DOI: http://dx.doi.org/10.1145/2617570

Index Terms

• Human-centered computing