The nature and quality of human-computer interaction (HCI) continues to be of interest to computer science researchers. While most advancement in this realm have come from practical experience, there had not been a great deal of theoretical or experimental research in advancing basic understanding. A new HCI conceptual framework focused on reality-based interactions has been advanced by Jacob et al. (2008). The core problem that the reality-based interaction (RBI) framework addresses is the need for users to more easily use an interface. The core proposition of the framework is that the more reality-based interactions that an interface incorporates, the easier and quicker a user will be able to use the interface. It was apparent from the review of the literature that there is little scientific evidence that supports or refutes this proposition and the framework.
The purpose of this study was to investigate whether a user's ability to interact with an interface improves with increases in the amount of reality-based interaction in that interface. More specifically, this research examined delivering instructions to a user for a 3-dimensional (3D) construction task through various reality-based interactions.
A review of the experimental design creation will be covered. The review will outline the entire development process of all conditions, creation of the conditions, and task selection and refinement. Once the preliminary development is covered, the experiment will be outlined in more detail.
The experimental design of this study employed 4 groups to obtain the necessary data to test the hypotheses. The groups were tested on various levels of reality-based interactions. Those treatment groups included the following: (1) a simple graphical user interface (GUI) with a simple slideshow of instructions, (2) a 3-dimensional representation of a person delivering instructions on a 2-dimensional monitor (referred to as the 3D condition ), (3) a 3-dimensional representation of a person delivering instructions in an augmented reality (AR) environment using a head-mounted display, and (4) an animatronic representation of a human being delivering instructions. Each of these interacted with subjects through gestures, speech, or pictures, but they did not interact with the construction task itself.
For this experiment, performance was measured in terms of 7 dependent variables. These dependent variables were divided into 2 groups. The first group included the number of times a step was repeated, the number of times human assistance was requested, and the total number of errors. The second group included the 4 types of errors that a subject could perform: incorrect connection, incorrect rotation, incorrect piece selection, and incorrect tilt or angle. The higher the occurrence of these dependent variables, the worse a subject's performance.
As was shown in the statistical results, there was a significant difference between interaction styles in all 3 of the first group's dependent variables. There were also significant differences between interaction styles in 2 of the dependent variables from the second group: incorrect piece and incorrect angle errors. Therefore, given these results, we are able to reject the null hypothesis and say that there is a significant difference in performance of a user's ability to complete a construction task delivered by 4 interaction styles with varying levels of reality-based interaction techniques.
Cited By
- Poor G, Jaffee S, Leventhal L, Ringenberg J, Klopfer D, Zimmerman G and Klein B (2016). Applying the Norman 1986 User-Centered Model to Post-WIMP UIs, ACM Transactions on Computer-Human Interaction, 23:5, (1-33), Online publication date: 18-Nov-2016.
- Hippler R, Klopfer D, Leventhal L, Poor G, Klein B and Jaffee S More than speed? an empirical study of touchscreens and body awareness on an object manipulation task Proceedings of the 14th international conference on Human-computer interaction: interaction techniques and environments - Volume Part II, (33-42)
Recommendations
Reality-based interaction: unifying the new generation of interaction styles
CHI EA '07: CHI '07 Extended Abstracts on Human Factors in Computing SystemsWe are in the midst of an explosion of emerging human-computer interaction techniques that have redefined our understanding of both computers and interaction. We propose the notion of Reality-Based Interaction (RBI) as a unifying concept that ties ...
Occlusion based interaction methods for tangible augmented reality environments
VRCAI '04: Proceedings of the 2004 ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industryTraditional Tangible Augmented Reality (Tangible AR) interfaces combine a mixture of tangible user interface and augmented reality technology, complementing each other for novel interaction methods and real world anchored visualization. However, well ...