Jake Goldenfein
ABSTRACT
Computer vision and other biometrics data science applications have commenced a new project of profiling people. Rather than using 'transaction generated information', these systems measure the 'real world' and produce an assessment of the 'world state' - in this case an assessment of some individual trait. Instead of using proxies or scores to evaluate people, they increasingly deploy a logic of revealing the truth about reality and the people within it. While these profiling knowledge claims are sometimes tentative, they increasingly suggest that only through computation can these excesses of reality be captured and understood. This article explores the bases of those claims in the systems of measurement, representation, and classification deployed in computer vision. It asks if there is something new in this type of knowledge claim, sketches an account of a new form of computational empiricism being operationalised, and questions what kind of human subject is being constructed by these technological systems and practices. Finally, the article explores legal mechanisms for contesting the emergence of computational empiricism as the dominant knowledge platform for understanding the world and the people within it.
- 1898. The New Sight and the New Photography.Google Scholar
- 2016-05-04. REGULATION (EU) No 2016/679 OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation). OJ L 119 (2016-05-04), 1--88.Google Scholar
- Saeed Abdullah, Mark Matthews, Ellen Frank, Gavin Doherty, Geri Gay, and Tanzeem Choudhury. 2016. Automatic detection of social rhythms in bipolar disorder. Journal of the American Medical Informatics Association 23, 3 (2016), 538--543.Google ScholarCross Ref
- Thomas Alley. 1988. Physiognomy and Social Perception. In Social and Applied Aspects of Perceiving Faces, Thomas Alley (Ed.). Laurence Erlbaum Publishers.Google Scholar
- Nalini Ambady and John Skowronski (eds). {n. d.}. First Impressions, year = 2008, isbn = 978-1593857165, publisher = The Guilford Press,.Google Scholar
- Mark Andrejevic. 2012. Brain Whisperers: Cutting Through the Clutter with Neuromarketing. Somatechnics 2(2) (2012), 198--215.Google Scholar
- Emily Apter. 2016. Shibboleth: Policing by Ear and Forensic Listening in Projects by Lawrence Abu Hamdan. October 156 (2016), 100--115.Google Scholar
- Yoshua Bengio, Aaron C. Courville, and Pascal Vincent. 2012. Unsupervised Feature Learning and Deep Learning: A Review and New Perspectives. CoRR abs/1206.5538 (2012). arXiv:1206.5538 http://arxiv.org/abs/1206.5538Google Scholar
- Walter Benjamin. 1980. A Short History of Photography 1934. In Classic Essays on Photography, Alan Trachtenberg (Ed.). Leete Island Books.Google Scholar
- Margaret Mitchell Blaise Agüera y Arcas and Alexander Todorov. 2017. Physiognomy's new Clothes. https://medium.com/@blaisea/physiognomys-new-clothes-f2d4b59fdd6aGoogle Scholar
- Solon Borocas and Andrew Selbst. 2016. Big Data's Disparate Impact. California Law Review 104(3) (2016), 671--732.Google Scholar
- James Bridle. 18 December 2013. How Britain Exported Next-Generation Surveillance. https://medium.com/matter/how-britain-exported-next-generation-surveillance-d15b5801b79eGoogle Scholar
- C. M. Brown. 1984. Computer Vision and Natural Constraints. 224, 4655 (1984), 1299--1305. arXiv:http://.mag.org/content/224/4655/1299.full.pdfGoogle Scholar
- Lee Bygrave. 2010. Privacy and Data Protection in an international perspective. Scandinavian Studies in Law 56(8) (2010), 165--200.Google Scholar
- Alvaro Bedoya Clare Garvie and Jonathan Frankle. 18 October 2018. The Perpetual Lineup: Unregulated Police Face Recognition in America. https:/www.perpetuallineup.org/Google Scholar
- Justin Clemens and Adam Nash. 2015. Being and Media: Digital Ontology after the Event of the End of Media. The Fibreculture Journal 24 (2015), 6--32.Google Scholar
- Kate Crawford. 2016. Can an Algorithm be Agonistic? Ten Scenes from Life in Calculated Publics., Technology & Human Values 41(1) (2016), 77--92.Google ScholarCross Ref
- Lorraine Daston and Peter Galison. 2007. Objectivity. Zone Books.Google Scholar
- Christopher Millard Dimitra Kamarinou and Jatinder Singh. 2016. Machine Learning with Personal Data. Technical Report 247. Queen Mary University of London School of Law Legal Studies Research Paper.Google Scholar
- Herbert Dreyfus. 2007. Why Heideggerian AI failed and how fixing it would require making it more Heideggarian. Artificial Intelligence 171(18) (2007), 1137--1160. Google ScholarDigital Library
- Didier Ottinger (ed). 2008. Futurism. Centre Pompidou Five Continent Editions.Google Scholar
- Paul Edwards. 1996. The Closed World: Computers and the Politics of Discourse in Cold War America. MIT. Google ScholarDigital Library
- Sergio Escalera, Xavier Baró, Hugo Jair Escalante, and Isabelle Guyon. 2017. ChaLearn Looking at People: Events and Resources. CoRR abs/1701.02664 (2017). arXiv:1701.02664 http://arxiv.org/abs/1701.02664Google Scholar
- Fred H. Cate et al. 2017. Machine Learning with Personal Data: Is Data Protection Law Smart Enough to Meet the Challenge? Technical Report 2634. Articles by Maurer Faculty.Google Scholar
- V Dominique et al. 1997. What Represents a Face? A Computational Approach for the Integration of Physiological and Psychological Data. Perception 26 (1997), 1271--1288.Google ScholarCross Ref
- Virginia Eubanks. 2018. Automating Inequality. St Martins Press.Google Scholar
- Vilém Flusser. 2000. Towards a Philosophy of Photography. Anthony Mathews trans in Reaktion Books.Google Scholar
- Francis Galton. 1879. Composite Portraits, Made by Combining Those of Many Different Persons into a Single Resultant Figure. Journal of the Anthropological Institute of Great Britain 3 (1879), 132--144.Google ScholarCross Ref
- William Gibson. 1984. Neuromancer. ACE Books.Google Scholar
- John Graham. 1961. Lavater's "Physiognomy": A Checklist. The Papers of the Bibliographical Society of America 55(4) (1961), 297--308.Google Scholar
- Ian Hacking. 1990. The Taming of Chance. Cambridge University Press.Google Scholar
- Bernard Harcourt. 2015. Exposed: Desire and Disobedience in the Digital Age. Harvard University Press. Google ScholarDigital Library
- Charles Hartshorne and Paul Weiss (eds). 1932. Collected Papers of Charles Sanders Peirce. Harvaed University Press.Google Scholar
- N Katherine Hayles. 1999. How We Became Post-Human: Virtual Bodies in Cybernetics, Literature and Infomatics. University of Chicago Press. Google ScholarDigital Library
- Douglas Heaven. 31 October 2018. An AI lie detector will interrogate travellers at some EU borders. https:/www.newscientist.com/article/mg24032023-400-an-ai-lie-detector-will-interrogate-travellers-at-some-eu-borders/Google Scholar
- Mireille Hildebrandt. {n. d.}. Privacy as Protection of the Incomputable Self: From Agnostic to Agonistic Machine Learning. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3081776Google Scholar
- Mireille Hildebrandt. 2018. Law as Computation in the era of artificial legal intelligence: Speaking Law to the Power of Statistics. University of Toronto Law Journal 68, 1 (Jan. 2018), 12--35.Google ScholarCross Ref
- Anna Hoffman and Luke Stark. 11 September 2015. Are Face Recognition Systems Accurate? Depends on Your Race. https:/www.technologyreview.com/s/601786/are-face-recognition-systems-accurate-depends-on-your-raceGoogle Scholar
- Paul Humphries. 1996. Computational Empiricism. In Topics in the Foundation of Statistics, Bas C. van Fraasen (Ed.). Springer.Google Scholar
- Sheila Jasanoff. 2017. Virtual, visible, and actionable: Data assemblages and the sightlines of justice. Big Data & Society 4, 2 (2017), 2053951717724477. arXiv:https://doi.org/10.1177/2053951717724477Google ScholarCross Ref
- Oscar H Gandy Jr. 2012. Statistical Surveillance: Remote Sensing in the Digital Age. In Routledge Handbook of Surveillance Studies, Kevin D Haggerty Kristie Ball and David Lyon (Eds.). Routledge.Google Scholar
- Júlio C. S. Jacques Júnior, Yagmur Güçlütürk, Marc Pérez, Umut Güçlü, Carlos Andújar, Xavier Baró, Hugo Jair Escalante, Isabelle Guyon, Marcel A. J. van Gerven, Rob van Lier, and Sergio Escalera. 2018. First Impressions: A Survey on Computer Vision-Based Apparent Personality Trait Analysis. CoRR abs/1804.08046 (2018). arXiv:1804.08046 http://arxiv.org/abs/1804.08046Google Scholar
- Jens Jäger. 2001. Photography: a means of surveillance? Judicial Photography 1850-1900. Crime, History & Societies 5(1) (2001), 27--51.Google Scholar
- Yarden Katz. {n. d.}. Manufacturing an Artificial Intelligence Revolution. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3078224Google Scholar
- Danielle Keats Citron and Frank Pasquale. 2014. The scored society: Due process for automated predictions. Washington Law Review 89 (2014), 1--33.Google Scholar
- Rob Kichin. 2014. Big data, New Epistemologies and Paradigm Shifts. Big Data and Society 1(1) (2014), (online).Google ScholarCross Ref
- Rob Kichin and Martin Dodge. 2011. Code/Space: Software and Everyday Life. MIT. Google ScholarDigital Library
- E Kozeny. 1962. Experimentelle Untersuchungen zur Ausdruckskunde mittel photographisch-statisticher Methode. Archive für die gesamte psychologic 114 (1962), 55--71.Google Scholar
- Robin Kramer and Kay Ritchie. 14 December 2016. The Trouble with Facial Recognition technology (in the real world). https://theconversation.com/the-trouble-with-facial-recognition-technology-in-the-real-world-69685Google Scholar
- Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. ImageNet Classification with Deep Convolutional Neural Networks. In Advances in Neural Information Processing Systems 25, F. Pereira, C. J. C. Burges, L. Bottou, and K. Q. Weinberger (Eds.). Curran Associates, Inc., 1097--1105. http://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf Google ScholarDigital Library
- Thomas Kuhn. 1961. The Function of Measurement in Modern Physical Science. Isis 52(2) (1961), 161--193.Google Scholar
- Yann LeCun, Yoshua Bengio, and Geoffrey E. Hinton. 2015. Deep learning. Nature 521, 7553 (2015), 436--444.Google Scholar
- Monique Mann and Marcus Smith. 2017. Automated facial recognition technology: Recent developments and approaches to oversight. University of New South Wales Law journal 40, 1 (2017), 121--145.Google Scholar
- Mary Warner Marien. 2015. Photography: A Cultural History (4th ed). Laurence King Publishing.Google Scholar
- Mark Matthews, Stephen Voida, Saeed Abdullah, Gavin Doherty, Tanzeem Choudhury, Sangha Im, and Geri Gay. 2015. In Situ Design for Mental Illness: Considering the Pathology of Bipolar Disorder in mHealth Design. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '15). ACM, New York, NY, USA, 86--97. Google ScholarDigital Library
- Roberta McGrath. 2002. Seeing her sex: Medical archives and the female body. Manchester University Press.Google Scholar
- Dan McQuillan. 2017. Data Science as Machinic Neoplatanism. Philosophy & Technology 31(2) (2017), 253--273.Google Scholar
- Isak Mendoza and Lee Bygrave. 2017. A Short History of Photography 1934. In EU Internet Law: Regulation and Enforcement, Taitani Synodinou et al (Ed.). Springer.Google Scholar
- Jacques-Alain Miller and Richard Miller. 1987. Jeremy Bentham's Panoptic Device. October 41 (1987), 3--29. http://www.jstor.org/stable/778327Google Scholar
- Roddam Narasimha. 2001. Axiomatism and Computational Positivism: Two Mathematical Cultures in Pursuit of Exact Sciences. Journal of Medical Humanities 22(2) (2001).Google Scholar
- Cathy O'Neil. 2016. Weapons of Math Destruction. Crown Books.Google Scholar
- Mike Orcutt. 6 July 2016. Are Face Recognition Systems Accurate? Depends on Your Race. https:/www.technologyreview.com/s/601786/are-face-recognition-systems-accurate-depends-on-your-raceGoogle Scholar
- Trevor Paglen. 8 December 2016. Invisible Images (Your Pictures are Looking at You). https://thenewinquiry.com/invisible-images-your-pictures-are-looking-at-you/Google Scholar
- Frank Pasquale. 20 Aug 2018. Odd Numbers. http://reallifemag.com/odd-numbers/Google Scholar
- Frank Pasquale. 2018. When Machine Learning is Facially Invalid. Commun. ACM 61, 9 (Aug. 2018), 25--27. Google ScholarDigital Library
- Simon JD Prince. 2012. Computer Vision: Models, Learning and Inference. Cambridge University Press. Google ScholarDigital Library
- Hairong Qi and Wesley E. Snyder. 2004. Machine Vision. Cambridge University Press.Google Scholar
- Nicole Rafter. 2005. The Murderous Dutch Fiddler: Criminology, History and the Problem of Phrenology. Theoretical Criminology 9(1) (2005), 65--96.Google ScholarCross Ref
- Vlad Savov. 17 May 2018. Google's Selfish Ledger is an Unsettling Vision of Silicon Valley Social Engineering. https:/www.theverge.com/2018/5/17/17344250/google-x-selfish-ledger-video-data-privacyGoogle Scholar
- Joshua Scannell. 17 September 2018. Controlled Measures. http://reallifemag.com/controlled-measures/Google Scholar
- Evan Selinger and Woodrow Hartzog. 22 June 2015. Opinion: It's time for an about-face on facial recognition. https:/www.csmonitor.com/World/Passcode/Passcode-Voices/2015/0622/Opinion-It-s-time-for-an-about-face-on-facial-recognitionGoogle Scholar
- Jonathan Sterne. 2001. Mediate Auscultation, the Stethoscope, and the "Autopsy of the Living": Medicine's Acoustic Culture. Journal of Medical Humanities 22, 2 (01 Jun 2001), 115--136.Google ScholarCross Ref
- Jordan G Teicher. 18 July 2018. What Do Facial Recognition Technologies Mean for our Privacy? https:/www.nytimes.com/2018/07/18/lens/what-do-facial-recognition-technologies-mean-for-our-privacy.htmlGoogle Scholar
- Valentin Thomas, Jules Pondard, Emmanuel Bengio, Marc Sarfati, Philippe Beaudoin, Marie-Jean Meurs, Joelle Pineau, Doina Precup, and Yoshua Bengio. 2017. Independently Controllable Factors. CoRR abs/1708.01289 (2017). arXiv:1708.01289 http://arxiv.org/abs/1708.01289Google Scholar
- Alexander Todorov. 2017. Face Value: The Irresistable Influence of First Impressions. Princeton University Press.Google Scholar
- Jeffrey M Valla, Stephen J Ceci, and Wendy M Williams. 2011. The Accuracy of Inferences about Criminality Based on Facial Appearance. Journal of Social, Evolutionary, and Cultural Psychology 5(2) (2011), 66--91.Google Scholar
- Jonathan Vanian. 13 July 2018. Microsoft President: Facial Recognition Technology Needs Government Regulation. http://fortune.com/2018/07/13/microsoft-facial-recognition-regulation/Google Scholar
- Rui Wang, Weichen Wang, Min S. H. Aung, Dror Ben-Zeev, Rachel Brian, Andrew T. Campbell, Tanzeem Choudhury, Marta Hauser, John Kane, Emily A. Scherer, and Megan Walsh. 2017. Predicting Symptom Trajectories of Schizophrenia Using Mobile Sensing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1,3, Article 110 (Sept. 2017), 24 pages. Google ScholarDigital Library
- Yilun Wang and Michal Kosinski. 2018. Deep Neural Networks are More Accurate than Humans at Detecting Sexual Orientation from Facial Images. Innovations in Social Psychology 114(2) (2018), 246--257. http://arxiv.org/abs/1701.02664Google Scholar
- Leif Weatherby. 2018. Digital Metaphysics: The Cybernetic Idealism of Warren McCulloch. https://iasc-culture.org/THR/THR_article_2018_Spring_Weatherby.phpGoogle Scholar
- J Willis and A Todorov. 2006. First Impressions: Making up your mind after 100ms exposure to a face. Psychological Science 17)7) (2006), 592--598.Google Scholar
- Xiaolin Wu and Xi Zhang. 2016. Automated Inference on Criminality using Face Images. CoRR abs/1611.04135 (2016). arXiv:1611.04135 http://arxiv.org/abs/1611.04135Google Scholar
- Hee-Deok Yang and Seong-Whan Lee. 2006. Automatic Physiognomic Analysis by Classifying Facial Component Feature., 1212--1215 pages. Google ScholarDigital Library
- Ting Zhang, Ri-Zhen Qin, Qiu-Lei Dong, Wei Gao, Hua-Rong Xu, and Zhan-Yi Hu. 2017. Physiognomy: Personality traits prediction by learning. International Journal of Automation and Computing 14, 4 (01 Aug 2017), 386--395. Google ScholarDigital Library
Index Terms
- The Profiling Potential of Computer Vision and the Challenge of Computational Empiricism
Recommendations
Empiricism in the foundations of cognition
AbstractThis paper traces the empiricist program from early debates between nativism and behaviorism within philosophy, through debates about early connectionist approaches within the cognitive sciences, and up to their recent iterations within the domain ...
What does it mean to embed ethics in data science? An integrative approach based on microethics and virtues
AbstractIn the past few years, scholars have been questioning whether the current approach in data ethics based on the higher level case studies and general principles is effective. In particular, some have been complaining that such an approach to ethics ...
Moral luck and computer ethics: Gauguin in cyberspace
I argue that the problem of `moral luck' is an unjustly neglected topic within Computer Ethics. This is unfortunate given that the very nature of computer technology, its `logical malleability', leads to ever greater levels of complexity, unreliability ...
Comments