Sketches by Paul the robot

ABSTRACT

In this paper we describe Paul, a robotic installation that produces observational sketches of people. The sketches produced have been considered of interest by fine art professionals in recent art fairs and exhibitions, as well as by the public at large. We identify factors that may account for the perceived qualities of the produced sketches. A technical overview of the system is also presented.

References

1. {Bra00} Bradski G.: Programmer's tool chest: The OpenCV library. Dr. Dobbs Journal (2000). 7
2. {Bre82} Brennan S.: Caricature Generator. Master's thesis, MIT, Sept. 1982. 3
3. {Bre02} Breazeal C.: Designing Sociable Robots. MIT press, Cambridge, MA, USA, 2002. 2
4. {C*04} Chen H., et al.: Example-based composite sketching of human portraits. In Proc. of NPAR (2004), ACM Press, pp. 95--102. 3
5. {CB97} Cohen D., Bennett S.: Why can't most people draw what they see? Journal of Experimental Psychology: Human Perception and Performance 23, 3 (1997), 609--621. 4
6. {CCCN*09} Coen-Cagli R., Coragio P., Napoletano P., et al.: Visuomotor characterization of eye movements in a drawing task. Vision Research 49, 8 (2009), 810--818. 4
7. {CH02} Collomosse J. P., Hall P.: Painterly rendering using image salience. In Proceedings 20th Eurographics (2002), pp. 122--128. 4
8. {Coh88} Cohen H.: How to draw three people in a botanical garden. In AAAI (1988), pp. 846--856. 3
9. {CS87} Crowley J. L., Sanderson A. C.: Multiple resolution representation and probabilistic matching of 2-d gray-scale shape. IEEE Trans. Pattern Anal. Mach. Intell. 9, 1 (Jan. 1987), 113--121. 7
10. {FLL92} Fol Leymarie F., Levine M. D.: Simulating the grassfire transform using an active contour model. IEEE Trans. Pattern Anal. Mach. Intell. 14, 1 (Jan. 1992), 56--75. 6
11. {GB10} Ghedini F., Bergamasco M.: Robotic creatures: Anthropomorphism and interaction in contemporary art. In IEEE Ro-Man 2010 International Symposium in Robot and Human Interactive Communication (2010), IEEE, pp. 731--736. 2
12. {GG01} Gooch B., Gooch A.: Non-photorealistic Rendering. A. K. Peters, 2001. 3
13. {Gra08} Granjon P.: Performing with machines and machines that perform. International Journal of Performance Arts and Digital Media 4 (2008), 45--57. 2
14. {GS11} Gemeinboeck P., Saunders R.: Zwischenraume: The machine as voyeur. In Proceedings of the first International Conference on Transdisciplinary Imagingat the Intersections between Art, Science and Culture (2011), pp. 62--70. 2
15. {HW59} Hubel D., Wiesel T.: Receptive fields of single neurons in the cat's striate cortex. In Journal of Physiology, vol. 148. Physiological society, London, 1959, pp. 574--591. 4
16. {IKN98} Itti L., Koch C., Niebur E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 11 (Nov 1998), 1254--1259. 4
17. {JP87} Jones J. P., Palmer L. A.: An evaluation of the two-dimensional gabor filter model of simple receptive fields in cat striate cortex. J Neurophysiol 58, 6 (December 1987), 1233--1258. 4, 7
18. {Kac97} Kac E.: Origin and development of robotic art. Art Journal 56, 3 (1997), 60--67. 2
19. {LM02} Lienhart R., Maydt J.: An extended set of Haar-like features for rapid object detection. In Proc. Int'l Conf. Image Processing (2002), pp. 900--903. 7
20. {Mac05} MacDorman K. F.: Androids as an experimental apparatus: Why is there an uncanny valley and can we exploit it? In Proceedings of the CogSci 2005 Workshop: Toward Social Mechanisms of Android Science (2005), pp. 106--118. 2
21. {Mas70} Mashiro M.: Bukimi no tani. Energy 7 (1970), 22--35. in Japanese; see MacDorman 2005, Appendix B, for English translation. 2
22. {MFN06} Metta G., Fitzpatrick P., Natale L.: Yarp: Yet another robot platform. International Journal of Advanced Robotics Systems, special issue on Software Development and Integration in Robotics 3, 1 (2006). 6
23. {Mou07} Moura L.: A new kind of art: The robotic action painter. In 10th Generative Art Conference (2007), pp. 16--22. 2
24. {PK97} Petkov N., Kruizinga P.: Computational models of visual neurons specialised in the detection of periodic and aperiodic oriented visual stimuli: bar and grating cells. Biological Cybernetics 76, 2 (1997), 83--96. 4, 7
25. {QCG*09} Quigley M., Conley K., Gerkey P., et al.: ROS: an open-source robot operating system. In ICRA Workshop on Open Source Software (2009). 6
26. {Raw87} Rawson P.: Drawing. University of Pennsylvania Press, Philadelphia, PA, USA, 1987. 7
27. {Rei87} Reichardt J.: Machines and art. Leonardo 20, 4 (1987), pp. 367--372. 2
28. {TFL06} Tresset P., Fol Leymarie F.: AIKON: The Artistic/Automatic IKONograph. In Proceedings of the ACM International Conference SIGGRAPH'06 (Boston, USA, July-August 2006). Research poster. 3
29. {TP11} Thai C., Paulishen M.: Using robotis bioloid systems for educational robotics. In Proceedings of the IEEE SouthEastern Conference (Nashville, TN, USA, 2011). 5
30. {VJ01} Viola P., Jones M.: Rapid object detection using a boosted cascade of simple features. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2001), pp. 511--518. 7
31. {VS84} Van Sommers P.: Drawing and cognition: Descriptive and experimental studies of graphic production processes. Cambridge university press, Cambridge, UK, 1984. 4
32. {Zek98} Zeki S.: Art and the brain. In Deadalus, vol. 127. MIT press, 1998, pp. 71--103. 3
33. {Ziv05} Zivanovic A.: The development of a cybernetic sculptor: Edward ihnatowicz and the senster. In Proceedings of the Fifth Conference on Creativity and Cognition (New York, NY, USA, 2005), ACM press, pp. 102--109. 2

Index Terms

• Computing methodologies

  • Computer graphics

    • Image manipulation

    • Rendering