Proxino: Enabling Prototyping of Virtual Circuits with Physical Proxies

ABSTRACT

We propose blending the virtual and physical worlds for prototyping circuits using physical proxies. With physical proxies, real-world components (e.g. a motor, or light sensor) can be used with a virtual counterpart for a circuit designed in software. We demonstrate this concept in Proxino, and elucidate the new scenarios it enables for makers, such as remote collaboration with physically distributed electronics components. We compared our hybrid system and its output with designs of real circuits to determine the difference through a system evaluation and observed minimal differences. We then present the results of an informal study with 9 users, where we gathered feedback on the effectiveness of our system in different working conditions (with a desktop, using a mobile, and with a remote collaborator). We conclude by sharing our lessons learned from our system and discuss directions for future research that blend physical and virtual prototyping for electronic circuits.

References

1. Altium Designer 17 Overview. http://www.altium.com/altium-designer/. Accessed in 2019.
2. Arduino. http://arduino.cc. Accessed in 2019.
3. Arduino Capacitive Sensing Library. https://playground.arduino.cc/Main/CapacitiveSensor. Accessed in 2019.
4. Arduino Distance Alarm. https://create.arduino.cc/projecthub/darwindelacruz/distan ce-alarm-system- 0ed9e5?ref=search&ref_id=distance%20sensor&offset=2. Accessed in 2019.
5. Arduino Starter Kit. https://store.arduino.cc/usa/arduinostarter- kit. Accessed in 2019.
6. Digilent Electronics Explorer. https://store.digilentinc.com/electronics-explorer-all-inone- usb-oscilloscope-multimeter-workstation/. Accessed in 2019
7. Fritzing Software. http://fritzing.org/home/. Accessed in 2019
8. LabView. http://www.ni.com/en-us/shop/labview.html. Accessed in 2019.
9. LiveSPICE. http://www.livespice.org. Accessed in 2019
10. TinkerCad Circuit. https://www.tinkercad.com/circuits. Accessed in 2019
11. VirtualBreadboard http://www.virtualbreadboard.com/.
12. Fraser Anderson, Tovi Grossman and George Fitzmaurice. 2017. Trigger-Action-Circuits: Leveraging Generative Design to Enable Novices to Design and Build Circuitry. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST'17), ACM, 331--342 DOI: http://doi.acm.org/10.1145/3126594.3126637
13. Johnson A Asumadu, R Tanner, J Fitzmaurice, M Kelly, H Ogunleye, J Belter and Song Chin Koh. 2003. A Webbased hands-on real-time electrical and electronics remote wiring and measurement laboratory (RwmLAB) instrument. In Proceedings of the 20th IEEE Instrumentation Technology Conference (Cat. No. 03CH37412), IEEE, 1032--1035. DOI: https://doi.org/10.1109/IMTC.2003.1207909
14. EAGLE PCB Design and Schematic Software. 2017
15. Tracey Booth, Simone Stumpf, Jon Bird and Sara Jones. 2016. Crossed wires: Investigating the problems of enduser developers in a physical computing task. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), ACM, 3485- 3497. DOI: https://doi.org/10.1145/2858036.2858533
16. Kayla DesPortes, Aditya Anupam, Neeti Pathak and Betsy DiSalvo. 2016. BitBlox: a redesign of the breadboard. In Proceedings of the 15th International Conference on Interaction Design and Children (IDC'16), ACM, 255- 261. DOI: https://doi.org/10.1145/2930674.2930708
17. Daniel Drew, Julie L Newcomb, William McGrath, Filip Maksimovic, David Mellis and Björn Hartmann. 2016. The Toastboard: Ubiquitous Instrumentation and Automated Checking of Breadboarded Circuits. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST'16), ACM, 677- 686. DOI: https://doi.org/10.1145/2984511.2984566
18. Adam Fourney and Michael Terry. 2012. PICL: portable in-circuit learner. In Proceedings of the 25th annual ACM symposium on User interface software and technology (UIST'12), ACM, 569--578. DOI: https://doi.org/0.1145/2380116.2380188
19. Saul Greenberg and Chester Fitchett. 2001. Phidgets: easy development of physical interfaces through physical widgets. In Proceedings of the 14th annual ACM symposium on User interface software and technology (UIST'01), ACM, 209--218. DOI: https://doi.org/10.1145/502348.502388.
20. Ingvar Gustavsson, Thomas Olsson, Henrik Åkesson, Johan Zackrisson and Lars Håkansson. 2005. A remote electronics laboratory for physical experiments using virtual breadboards. In Proceedings of the 2005 ASEE Annaual Conference, 12--15.
21. Björn Hartmann, Leith Abdulla, Manas Mittal and Scott R Klemmer. 2007. Authoring sensor-based interactions by demonstration with direct manipulation and pattern recognition. In Proceedings of the SIGCHI conference on Human factors in computing systems (CHI'07), ACM, 145--154. DOI: https://doi.org/10.1145/1240624.1240646
22. Björn Hartmann, Scott R Klemmer, Michael Bernstein, Leith Abdulla, Brandon Burr, Avi Robinson-Mosher and Jennifer Gee. 2006. Reflective physical prototyping through integrated design, test, and analysis. In Proceedings of the 19th annual ACM symposium on User interface software and technology (UIST'06), ACM, 299- 308. DOI: https://doi.org/10.1145/1166253.1166300
23. Steve Hodges, Nicolas Villar, Nicholas Chen, Tushar Chugh, Jie Qi, Diana Nowacka and Yoshihiro Kawahara. 2014. Circuit stickers: peel-and-stick construction of interactive electronic prototypes. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'14), ACM, 1743--1746. DOI: https://doi.org/10.1145/2556288.2557150
24. Steven Houben, Connie Golsteijn, Sarah Gallacher, Rose Johnson, Saskia Bakker, Nicolai Marquardt, Licia Capra and Yvonne Rogers. 2016. Physikit: Data engagement through physical ambient visualizations in the home. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), ACM, 1608- 1619. DOI: https://doi.org/10.1145/2858036.2858059
25. Yoshihiro Kawahara, Steve Hodges, Benjamin S. Cook, Cheng Zhang and Gregory D. Abowd. 2013. Instant inkjet circuits: lab-based inkjet printing to support rapid prototyping of UbiComp devices. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing (UbiComp'13), ACM, 363--372. DOI: https://doi.org/10.1145/2493432.2493486
26. Majeed Kazemitabaar, Jason McPeak, Alexander Jiao, Liang He, Thomas Outing and Jon E Froehlich. 2017. Makerwear: A tangible approach to interactive wearable creation for children. In Proceedings of the 2017 CHI conference on human factors in computing systems (CHI'17), ACM, 133--145. DOI: https://doi.org/10.1145/3025453.3025887
27. Yoonji Kim, Youngkyung Choi, Hyein Lee, Geehyuk Lee and Andrea Bianchi. 2019. VirtualComponent: A Mixed- Reality Tool for Designing and Tuning Breadboarded Circuits. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI'19). DOI: https://doi.org/10.1145/3290605.3300407
28. André Knörig, Reto Wettach and Jonathan Cohen. 2009. Fritzing: a tool for advancing electronic prototyping for designers. In Proceedings of the 3rd International Conference on Tangible and Embedded Interaction (TEI'09), ACM, 351--358. DOI: https://doi.org/10.1145/1517664.1517735
29. Jo-Yu Lo, Da-Yuan Huang, Tzu-Sheng Kuo, Chen-Kuo Sun, Jun Gong, Teddy Seyed, Xing-Dong Yang and Bing- Yu Chen. 2019. AutoFritz: Autocomplete for Prototyping Virtual Breadboard Circuits. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI'19). DOI: https://doi.org/10.1145/3290605.3300633
30. Joanne Lo, Cesar Torres, Isabel Yang, Jasper O'Leary, Danny Kaufman, Wilmot Li, Mira Dontcheva and Eric Paulos. 2016. Aesthetic Electronics: Designing, Sketching, and Fabricating Circuits Through Digital Exploration. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST'16), ACM, 665--676. DOI: https://doi.org/10.1145/2984511.2984579
31. Will McGrath, Daniel Drew, Jeremy Warner, Majeed Kazemitabaar, Mitchell Karchemsky, David Mellis and Björn Hartmann. 2017. Bifröst: Visualizing and Checking Behavior of Embedded Systems across Hardware and Software. in Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST'17), ACM, 299--310. DOI: https://doi.org/10.1145/2901790.2901833
32. David A Mellis, Leah Buechley, Mitchel Resnick and Björn Hartmann. 2016. Engaging amateurs in the design, fabrication, and assembly of electronic devices. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS'16), ACM, 1270--1281. DOI: https://doi.org/10.1145/2901790.2901833
33. Raf Ramakers, Fraser Anderson, Tovi Grossman and George Fitzmaurice. 2016. Retrofab: A design tool for retrofitting physical interfaces using actuators, sensors and 3d printing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), ACM, 409--419. DOI: https://doi.org/10.1145/2858036.2858485
34. Raf Ramakers, Kashyap Todi and Kris Luyten. 2015. PaperPulse: an integrated approach for embedding electronics in paper designs. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI'15), ACM, 2457--2466. DOI: https://doi.org/10.1145/2702123.2702487
35. Mitchel Resnick, Fred Martin, Randy Sargent and Brian Silverman. 1996. Programmable bricks: Toys to think with. IBM Systems journal, 35 (3.4). 443--452. DOI: http://dx.doi.org/10.1147/sj.353.0443
36. Nuno Sousa, Gustavo R Alves and Manuel G Gericota. 2010. An integrated reusable remote laboratory to complement electronics teaching. IEEE Transactions on learning technologies. 265--271. DOI: https://doi.org/10.1109/TLT.2009.51
37. Evan Strasnick, Maneesh Agrawala and Sean Follmer. 2017. Scanalog: Interactive Design and Debugging of Analog Circuits with Programmable Hardware. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST'17), ACM, 321- 330. DOI: http://doi.acm.org/10.1145/3126594.3126618
38. Nicolas Villar, James Scott, Steve Hodges, Kerry Hammil and Colin Miller. 2012. NET gadgeteer: a platform for custom devices. In International Conference on Pervasive Computing, Springer, 216--233. DOI: https://doi.org/10.1007/978--3--642--31205--2_14
39. Chiuan Wang, Hsuan-Ming Yeh, Bryan Wang, Te-Yen Wu, Hsin-Ruey Tsai, Rong-Hao Liang, Yi-Ping Hung and Mike Y Chen. 2016. CircuitStack: supporting rapid prototyping and evolution of electronic circuits. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST'16), ACM, 687- 695. DOI: http://doi.acm.org/10.1145/2984511.2984527
40. Te-Yen Wu, Hao-Ping Shen, Yu-Chian Wu, Yu-An Chen, Pin-Sung Ku, Ming-Wei Hsu, Jun-You Liu, Yu-Chih Lin and Mike Y Chen. 2017. CurrentViz: Sensing and Visualizing Electric Current Flows of Breadboarded Circuits. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST'17), ACM, 343--349. DOI: http://doi.acm.org/10.1145/3126594.3126646
41. Te-Yen Wu, Bryan Wang, Jiun-Yu Lee, Hao-Ping Shen, Yu-Chian Wu, Yu-An Chen, Pin-sung Ku, Ming-Wei Hsu, Yu-Chih Lin and Mike Y Chen. 2017. CircuitSense: Automatic Sensing of Physical Circuits and Generation of Virtual Circuits to Support Software Tools. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST'17), ACM, 311- 319. DOI: http://doi.acm.org/10.1145/3126594.3126634

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interactive systems and tools

      • User interface toolkits