As computers proliferate and as the field of computer graphics matures, it has become increasingly important for computer scientists to understand how users perceive and interpret computer graphics. Experimental Design: From User Studies to Psychophysics is an accessible introduction to psychological experiments and experimental design, covering the major components in the design, execution, and analysis of perceptual studies. The book begins with an introduction to the concepts central to designing and understanding experiments, including developing a research question, setting conditions and controls, and balancing specificity with generality. The book then explores in detail a number of types of experimental tasks: free description, rating scales, forced-choice, specialized multiple choice, and real-world tasks as well as physiological studies. It discusses the advantages and disadvantages of each type and provides examples of that type of experiment from the authors own work. The book also covers stimulus-related issues, including popular stimulus resources. It concludes with a thorough examination of statistical techniques for analyzing results, including methods specific to individual tasks.
Cited By
- Sterzik A, Lichtenberg N, Wilms J, Krone M, Cunningham D and Lawonn K (2024). Perception of Line Attributes for Visualization, IEEE Transactions on Visualization and Computer Graphics, 30:1, (1041-1051), Online publication date: 1-Jan-2024.
- Wisessing P, Zibrek K, W. Cunningham D and Mcdonnell R A psychophysical model to control the brightness and key-to-fill ratio in CG cartoon character lighting ACM Symposium on Applied Perception 2019, (1-7)
- Hahn P, Castillo S and Cunningham D Fitting the Style Proceedings of the 32nd International Conference on Computer Animation and Social Agents, (21-24)
- Meuschke M, Smit N, Lichtenberg N, Preim B and Lawonn K Automatic generation of web-based user studies to evaluate depth perception in vascular surface visualizations Proceedings of the Eurographics Workshop on Visual Computing for Biology and Medicine, (33-44)
- Luo S and Dingliana J Transfer function optimization based on a combined model of visibility and saliency Proceedings of the 33rd Spring Conference on Computer Graphics, (1-10)
- Allue M, Serrano A, Bedia M and Masia B Crossmodal perception in immersive environments Proceedings of the XXVI Spanish Computer Graphics Conference, (1-7)
- Voit A, Machulla T, Weber D, Schwind V, Schneegass S and Henze N Exploring notifications in smart home environments Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, (942-947)
- Preim B, Baer A, Cunningham D, Isenberg T and Ropinski T (2016). A Survey of Perceptually Motivated 3D Visualization of Medical Image Data, Computer Graphics Forum, 35:3, (501-525), Online publication date: 1-Jun-2016.
- Faridul H, Pouli T, Chamaret C, Stauder J, Reinhard E, Kuzovkin D and Tremeau A (2016). Colour Mapping, Computer Graphics Forum, 35:1, (59-88), Online publication date: 1-Feb-2016.
- Papadopoulos C, Gutenko I and Kaufman A (2015).
VEEVVIE: Visual Explorer for Empirical Visualization, VR and Interaction Experiments, IEEE Transactions on Visualization and Computer Graphics, 22:1, (111-120), Online publication date: 31-Jan-2016. - Zell E, Aliaga C, Jarabo A, Zibrek K, Gutierrez D, McDonnell R and Botsch M (2015). To stylize or not to stylize?, ACM Transactions on Graphics, 34:6, (1-12), Online publication date: 4-Nov-2015.
- Dahl G and Kraus M Measuring how game feel is influenced by the player avatar's acceleration and deceleration Proceedings of the 19th International Academic Mindtrek Conference, (41-46)
- Legde K, Castillo S and Cunningham D (2015). Multimodal Affect, ACM Transactions on Applied Perception, 12:4, (1-17), Online publication date: 8-Sep-2015.
- Gain J, Merry B and Marais P (2015). Parallel, Realistic and Controllable Terrain Synthesis, Computer Graphics Forum, 34:2, (105-116), Online publication date: 1-May-2015.
- Koulieris G, Drettakis G, Cunningham D and Mania K (2014). An Automated High-Level Saliency Predictor for Smart Game Balancing, ACM Transactions on Applied Perception, 11:4, (1-21), Online publication date: 9-Jan-2015.
- McNamara A, Mania K, Koulieris G and Itti L Attention-aware rendering, mobile graphics and games ACM SIGGRAPH 2014 Courses, (1-119)
- Jarabo A, Masia B, Bousseau A, Pellacini F and Gutierrez D (2014). How do people edit light fields?, ACM Transactions on Graphics, 33:4, (1-10), Online publication date: 27-Jul-2014.
- Castillo S, Wallraven C and Cunningham D (2014). The semantic space for facial communication, Computer Animation and Virtual Worlds, 25:3-4, (225-233), Online publication date: 1-May-2014.
- Nicosia M, Oulasvirta A and Kristensson P Modeling the perception of user performance Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (1747-1756)
- Easa H, Mantiuk R and Lim I (2013). Evaluation of monocular depth cues on a high-dynamic-range display for visualization, ACM Transactions on Applied Perception, 10:3, (1-13), Online publication date: 1-Aug-2013.
- Mantiuk R, Tomaszewska A and Mantiuk R (2012). Comparison of Four Subjective Methods for Image Quality Assessment, Computer Graphics Forum, 31:8, (2478-2491), Online publication date: 1-Dec-2012.
- Aubrey A, Cunningham D, Marshall D, Rosin P, Shin A and Wallraven C The face speaks Proceedings of the 11th international conference on Computer Vision - Volume 2, (248-259)
Recommendations
Experimental game design
Game Research MethodsOne way to understand games better is to experiment with their design. While experimental game design is part of most game design, this chapter focuses on ways in which it can become amethod to perform academic enquiry, eliciting deeper principles for ...
Design and Development of an Experimental Design and Evaluation System
IMCCC '14: Proceedings of the 2014 Fourth International Conference on Instrumentation and Measurement, Computer, Communication and ControlThis paper develops an experimental and Evaluation system which accelerates the construction of experimental scheme. At the same time, it helps with the creation of experiment samples and evaluation of the impact of experiment variable attributes. Based ...
Experimental economics and experimental computer science: a survey
ecs'07: Experimental computer science on Experimental computer scienceMany of computer scientists' research projects avail themselves to experimental studies using economic incentives and formulation of economically motivated hypotheses.
In this article I argue that these projects can benefit from the large body of work ...