Abstract
Mixed Reality (MR), Augmented Reality (AR) and Virtual Reality (VR) headsets can improve upon existing physical multi-display environments by rendering large, ergonomic virtual display spaces whenever and wherever they are needed. However, given the physical and ergonomic limitations of neck movement, users may need assistance to view these display spaces comfortably. Through two studies, we developed new ways of minimising the physical effort and discomfort of viewing such display spaces. We first explored how the mapping between gaze angle and display position could be manipulated, helping users view wider display spaces than currently possible within an acceptable and comfortable range of neck movement. We then compared our implicit control of display position based on head orientation against explicit user control, finding significant benefits in terms of user preference, workload and comfort for implicit control. Our novel techniques create new opportunities for productive work by leveraging MR headsets to create interactive wide virtual workspaces with improved comfort and usability. These workspaces are flexible and can be used on-the-go, e.g., to improve remote working or make better use of commuter journeys.
Supplemental Material
- James A. Anderson, Jennifer Hill, Paul Parkin, and Autumn Garisson. 2007. Productivity, screens, and aspect ratios; A comparison of single, traditional aspect, dual, traditional aspect and single, widescreen aspect computer. Illinois: NEC Display Solutions. https://collections.lib.utah.edu/details?id=214166.Google Scholar
- Christopher Andrews, Alex Endert, and Chris North. 2010. Space to think: Large, high-resolution displays for sensemaking. In Proceedings of the 28th International Conference on Human Factors in Computing Systems (CHI’10). ACM Press, New York, New York, 55. DOI:https://doi.org/10.1145/1753326.1753336Google ScholarDigital Library
- Christopher Andrews and Chris North. 2012. Analyst’s workspace: An embodied sensemaking environment for large, high-resolution displays. In Proceedings of the 2012 IEEE Conference on Visual Analytics Science and Technology (VAST’12). IEEE, 123--131. DOI:https://doi.org/10.1109/VAST.2012.6400559Google ScholarDigital Library
- Mark Ashdown, Kenji Oka, and Yoichi Sato. 2005. Combining head tracking and mouse input for a GUI on multiple monitors. In CHI’05 Extended Abstracts on Human Factors in Computing Systems (CHI EA’05). ACM, New York, NY, 1188--1191. DOI:https://doi.org/10.1145/1056808.1056873Google Scholar
- Robert Ball and Chris North. 2005. Effects of tiled high-resolution display on basic visualization and navigation tasks. In Proceedings of the Extended Abstracts on Human Factors in Computing Systems (CHI’05). ACM Press, New York, New York, 1196. DOI:https://doi.org/10.1145/1056808.1056875Google ScholarDigital Library
- Robert Ball, Chris North, and Doug A. Bowman. 2007. Move to improve: Promoting physical navigation to increase user performance with large displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 191--200. DOI:https://doi.org/10.1145/1240624.1240656Google Scholar
- Borbála Berki. 2019. Desktop VR as a virtual workspace: A cognitive aspect. Acta Polytechnica Hungarica 16, 2 (2019), 219--231. DOI:https://doi.org/10.12700/APH.16.2.2019.2.13Google Scholar
- Xiaojun Bi and Ravin Balakrishnan. 2009. Comparing usage of a large high-resolution display to single or dual desktop displays for daily work. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1005--1014. DOI:https://doi.org/10.1145/1518701.1518855Google ScholarDigital Library
- Xiaojun Bi, Tovi Grossman, Justin Matejka, and George Fitzmaurice. 2011. Magic desk: Bringing multi-touch surfaces into desktop work. In Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems (CHI’11). 2511. DOI:https://doi.org/10.1145/1978942.1979309Google ScholarDigital Library
- Bigscreen Inc. 2017. Bigscreen beta. steampowered.com (2017). Retrieved from http://store.steampowered.com/app/457550/Bigscreen_Beta/.Google Scholar
- Renaud Blanch and Michaël Ortega. 2009. Rake cursor: Improving pointing performance with concurrent input channels. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’09). ACM, New York, NY, 1415--1418. DOI:https://doi.org/10.1145/1518701.1518914Google ScholarDigital Library
- Gunnar Borg. 1998. Borg’s perceived exertion and pain scales. Human Kinetics. DOI:https://doi.org/10.1097/00005768-199809000-00018Google Scholar
- J. Carlton Collins. 2011. Increase Productivity With Multiple Monitors. Retrieved from http://www.journalofaccountancy.com/issues/2011/feb/20103260.html.Google Scholar
- Mark Coppock. 2017. How to split your screen and manage your work in Windows 10. Retrieved from http://www.digitaltrends.com/computing/how-to-split-your-screen-in-windows-10/.Google Scholar
- Mary Czerwinski, George Robertson, Brian Meyers, Greg Smith, Daniel Robbins, and Desney Tan. 2006. Large display research overview. In Proceedings of the Extended Abstracts on Human Factors in Computing Systems. 69. DOI:https://doi.org/10.1145/1125451.1125471Google ScholarDigital Library
- Mary Czerwinski, Greg Smith, Tim Regan, Brian Meyers, George Robertson, and Gary Starkweather. 2003. Toward characterizing the productivity benefits of very large displays. Interact 3 (2003), 9--16. Retrieved from http://research.microsoft.com/en-us/um/redmond/groups/cue/publications/interact2003-productivitylargedisplays.pdf.Google Scholar
- Jakub Dostal, Per Ola Kristensson, and Aaron Quigley. 2013. Subtle gaze-dependent techniques for visualising display changes in multi-display environments. In Proceedings of the 2013 International Conference on Intelligent User Interfaces (IUI’13) . 137. DOI:https://doi.org/10.1145/2449396.2449416 arxiv:arXiv:1011.1669v3Google ScholarDigital Library
- Steve Draper. 2018. Effect size. Retrieved from http://www.psy.gla.ac.uk/ steve/best/effect.html.Google Scholar
- Heiko Drewes and Albrecht Schmidt. 2009. The MAGIC touch: Combining MAGIC-pointing with a touch-sensitive mouse. In Proceedings of the Human-Computer Interaction (INTERACT’09). Springer, Berlin, 415--428. DOI:https://doi.org/10.1007/978-3-642-03658-3_46Google ScholarDigital Library
- Alex Endert, Lauren Bradel, Jessica Zeitz, Christopher Andrews, Chris North, and Virginia Tech. 2012. Designing large high-resolution display workspaces. In Proceedings of the International Working Conference on Advanced Visual Interfaces. 58--65. DOI:https://doi.org/10.1145/2254556.2254570Google ScholarDigital Library
- Alex Endert, Patrick Fiaux, Haeyong Chung, Michael Stewart, Christopher Andrews, and Chris North. 2011. ChairMouse: Leveraging natural chair rotation for cursor navigation on large, high-resolution displays. In Proceedings of the Extended Abstracts on Human Factors in Computing Systems (CHI EA’11). ACM, New York, NY, 571--580. DOI:https://doi.org/10.1145/1979742.1979628Google ScholarDigital Library
- Barrett Ens, Juan David Hincapié-Ramos, and Pourang Irani. 2014. Ethereal planes: A design framework for 2D information space in 3D mixed reality environments. In Proceedings of the 2nd ACM Symposium on Spatial User Interaction. 2--12. DOI:https://doi.org/10.1145/2659766.2659769Google ScholarDigital Library
- Barrett Ens and Pourang Irani. 2017. Spatial analytic interfaces: Spatial user interfaces for in situ visual analytics. IEEE Computer Graphics and Applications 37, 2 (Mar 2017), 66--79. DOI:https://doi.org/10.1109/MCG.2016.38Google ScholarDigital Library
- Barrett Ens, Eyal Ofek, Neil Bruce, and Pourang Irani. 2016. Shared Façades: Surface-embedded layout management for ad hoc collaboration using head-worn displays. In Collaboration Meets Interactive Spaces. Springer International Publishing, Cham, 153--176. DOI:https://doi.org/10.1007/978-3-319-45853-3_8Google Scholar
- Barrett M. Ens, Rory Finnegan, and Pourang P. Irani. 2014. The personal cockpit: A spatial interface for effective task switching on head-worn displays. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI’14).3171--3180. DOI:https://doi.org/10.1145/2556288.2557058Google Scholar
- Sean Fanello, Sergio Orts-escolano Christoph Rhemann, Mingsong Dou, Vladimir Tankovich, Charles Loop, and Philip Chou. 2016. Holoportation: Virtual 3D teleportation in real-time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST’16). 741--754. DOI:https://doi.org/10.1145/2984511.2984517Google Scholar
- Amanda M. Farias Zuniga and Julie N. Côté. 2017. Effects of dual monitor computer work versus laptop work on cervical muscular and proprioceptive characteristics of males and females. Human Factors 59, 4 (2017), 546--563. DOI:https://doi.org/10.1177/0018720816684690Google ScholarCross Ref
- Hilary L. Gallagher, Erin Caldwell, and Christopher B. Albery. 2008. Neck Muscle Fatigue Resulting from Prolonged Wear of Weighted Helmets. Technical Report. 1--27 pages. Retrieved from http://www.dtic.mil/docs/citations/ADA491626.Google Scholar
- Fernando Garcia-Sanjuan, Javier Jaen, and Vicente Nacher. 2016. Toward a general conceptualization of multi-display environments. Frontiers in ICT 3 (Sep 2016), 20. DOI:https://doi.org/10.3389/fict.2016.00020Google Scholar
- Thomas Geymayer, Manuela Waldner, Alexander Lex, and Dieter Schmalstieg. 2017. How sensemaking tools influence display space usage. In Proceedings of the EuroVis Workshop on Visual Analytics. DOI:https://doi.org/10.2312/eurova.20171112Google Scholar
- Guy Godin. 2017. Virtual Desktop. Retrieved from https://store.steampowered.com/app/382110/Virtual_Desktop/.Google Scholar
- Jens Grubert, Matthias Heinisch, Aaron Quigley, and Dieter Schmalstieg. 2015. MultiFi: Multi-fidelity interaction with displays on and around the body. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’15) . 3933--3942. DOI:https://doi.org/10.1145/2702123.2702331Google ScholarDigital Library
- Jonathan Grudin. 2001. Partitioning digital worlds: Focal and peripheral awareness in multiple monitor use. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’01). 458--465. DOI:https://doi.org/10.1145/365024.365312Google ScholarDigital Library
- Peter A. Hancock, Ben D. Sawyer, and Shawn C. Stafford. 2015. The effects of display size on performance. Ergonomics 58, 3 (Mar 2015), 337--354. DOI:https://doi.org/10.1080/00140139.2014.973914Google ScholarCross Ref
- Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (task load index): Results of empirical and theoretical research. In Human Mental Workload 52 (1988), 139-183. Retrieved from http://humanfactors.arc.nasa.gov/groups/TLX/downloads/NASA-TLXChapter.pdf.Google ScholarCross Ref
- Hecomi. 2019. Desktop Duplication API implementation for Unity. Retrieved from https://github.com/hecomi/uDesktopDuplication.Google Scholar
- Jerry L. Hintze and Ray D. Nelson. 1998. Violin plots: A box plot-density trace synergism. The American Statistician 52, 2 (1998), 181--184. DOI: http://amstat.tandfonline.com/doi/abs/10.1080/00031305.1998.10480559Google ScholarCross Ref
- Philipp Hock, Sebastian Benedikter, Jan Gugenheimer, and Enrico Rukzio. 2017. CarVR: Enabling in-car virtual reality entertainment. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. DOI:https://doi.org/10.1145/3025453.3025665Google ScholarDigital Library
- Raphael Hoffmann, Patrick Baudisch, and Daniel S. Weld. 2008. Evaluating visual cues for window switching on large screens. In Proceedings of ACM CHI 2008 Conference on Human Factors in Computing Systems. Vol. 1. 929--938. DOI:https://doi.org/10.1145/1357054.1357199Google Scholar
- Nic Hollinworth and Faustina Hwang. 2011. Cursor relocation techniques to help older adults find ‘lost’ cursors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’11). ACM, New York, NY, 863--866. DOI:https://doi.org/10.1145/1978942.1979068Google ScholarDigital Library
- Seokjun Hong and Gerard J. Kim. 2016. Accelerated viewpoint panning with rotational gain in 360 degree videos. In Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology (VRST’16). 303--304. DOI:https://doi.org/10.1145/2993369.2996309Google Scholar
- Cory House. 2017. Why I Stopped Using Multiple Monitors. Retrieved from https://hackernoon.com/why-i-stopped-using-multiple-monitors-bfd87efa2e5b.Google Scholar
- Peter Alan Howarth and Howell Owen Istance. 2007. The association between visual discomfort and the use of visual display units. Behaviour 8 Information Technology 4, 2 (Apr 2007), 131--149. DOI:https://doi.org/10.1080/01449298508901794Google Scholar
- Dugald R. Hutchings and Mary Czerwinski. 2004. Exploring the use and affordances of multiple display environments. In Proceedings of the Workshop on Ubiquitous Display Environments at UbiComp. 1--6. Retrieved from http://www.academia.edu/download/43905386/Exploring_the_use_and_affordances_of_mul20160319-5093-k2rhth.pdf.Google Scholar
- Dugald R. Hutchings, Greg Smith, Brian Meyers, Mary Czerwinski, and George Robertson. 2004. Display space usage and window management operation comparisons between single monitor and multiple monitor users. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI’04). 32--39. DOI:https://doi.org/10.1145/989863.989867Google ScholarDigital Library
- Dugald R. Hutchings and John Stasko. 2004. Revisiting display space management: Understanding current practice to inform next-generation design. In Proceedings of the Conference on Graphics, Visualization 8 HCI (GI’04). Vol. 62. 127--134. DOI: http://dl.acm.org/citation.cfm?id=1006058.1006074Google Scholar
- Dugald R. Hutchings and John Stasko. 2007. Consistency, multiple monitors, and multiple windows. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’07). 211. DOI:https://doi.org/10.1145/1240624.1240658Google Scholar
- P. M. Jaekl, M. R. Jenkin, and Laurence R. Harris. 2005. Perceiving a stable world during active rotational and translational head movements. Experimental Brain Research 163, 3 (Jun 2005), 388--399. DOI:https://doi.org/10.1007/s00221-004-2191-8Google ScholarCross Ref
- Steven Jeuris and Jakob E. Bardram. 2016. Dedicated workspaces: Faster resumption times and reduced cognitive load in sequential multitasking. Computers in Human Behavior 62 (Sep 2016), 404--414. DOI:https://doi.org/10.1016/j.chb.2016.03.059Google Scholar
- James C. Johnston, Eric Ruthruff, and M.-C. Lien. 2014. Visual information processing from multiple displays. Human Factors: The Journal of the Human Factors and Ergonomics Society 57, 2 (Mar 2014), 276--297. DOI:https://doi.org/10.1177/0018720814545974Google Scholar
- Youn-ah Kang and John Stasko. 2008. Lightweight Task/Application Performance Using Single Versus Multiple Monitors: A Comparative Study. In Proceedings of Graphics Interface 2008. 17--24. DOI:https://doi.org/10.1145/1056808.1056875Google Scholar
- Abhijit Karnik, Tovi Grossman, and Sriram Subramanian. 2013. Comparison of User Performance in Mixed 2D-3D Multi-Display Environments. Springer, Berlin, 260--277. DOI:https://doi.org/10.1007/978-3-642-40483-2_18Google Scholar
- Kevin Kelly. 2016. The Untold Story of Magic Leap, the World’s Most Secretive Startup. Retrieved from https://www.wired.com/?p=1999666Google Scholar
- Robert S. Kennedy, Norman E. Lane, Kevin S. Berbaum, and Michael G. Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The International Journal of Aviation Psychology 3, 3 (Jul 1993), 203--220. DOI:https://doi.org/10.1207/s15327108ijap0303_3Google ScholarCross Ref
- Hermann Klinke, Christoph Krieger, and Sebastian Pickl. 2014. Analysis of the influence of screen size and resolution on work efficiency. University of Stuttgart. DOI:https://doi.org/10.18419/OPUS-3489Google Scholar
- Søren Knudsen, Mikkel Rønne Jakobsen, and Kasper Hornbæk. 2012. An exploratory study of how abundant display space may support data analysis. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction Making Sense Through Design (NordiCHI’12). 558--567. DOI:https://doi.org/10.1145/2399016.2399102Google ScholarDigital Library
- Masatomo Kobayashi and Takeo Igarashi. 2008. Ninja cursors: Using multiple cursors to assist target acquisition on large screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’08). ACM, New York, NY, 949--958. DOI:https://doi.org/10.1145/1357054.1357201Google ScholarDigital Library
- Martin Krzywinski and Naomi Altman. 2014. Points of significance: Visualizing samples with box plots. Nature Methods 11, 2 (Jan 2014), 119--120. DOI:https://doi.org/10.1038/nmeth.2813Google ScholarCross Ref
- Scott A. Kuhl, Sarah H. Creem-Regehr, and William B. Thompson. 2008. Recalibration of rotational locomotion in immersive virtual environments. ACM Transactions on Applied Perception 5, 3 (Aug 2008), 1--11. DOI:https://doi.org/10.1145/1402236.1402241Google ScholarDigital Library
- Hyelip Lee, Seungwoo Je, Rachel Kim, Himanshu Verma, Hamed Alavi, and Andrea Bianchi. 2019. Partitioning open-plan workspaces via augmented reality. Personal and Ubiquitous Computing (Oct 2019). DOI: DOI:https://doi.org/10.1007/s00779-019-01306-0Google Scholar
- Hae Jin Lee. 2017. Taking the Leap from 2D to 3D. Retrieved from https://medium.com/microsoft-design/taking-the-leap-from-2d-to-3d-4199ccc777a1.Google Scholar
- Russell V. Lenth. 2016. Least-squares means: The R package lsmeans. Journal of Statistical Software 69, 1 (2016), 1--33. Retrieved from https://www.jstatsoft.org/article/view/v069i01/v69i01.pdf.Google ScholarCross Ref
- Zhen Li, Michelle Annett, Ken Hinckley, Karan Singh, and Daniel Wigdor. 2019. HoloDoc: Enabling mixed reality workspaces that harness physical and digital content. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI’19). ACM, New York, NY, Article 687, 14 pages. DOI:https://doi.org/10.1145/3290605.3300917Google ScholarDigital Library
- David Lindlbauer, Klemen Lilija, Robert Walter, and Jörg Müller. 2016. Influence of display transparency on background awareness and task performance. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 1705--1716. DOI:https://doi.org/10.1145/2858036.2858453Google ScholarDigital Library
- Chen Ling, Alex Stegman, Chintan Barhbaya, and Randa Shehab. 2017. Are two better than one? A comparison between single- and dual-monitor work stations in productivity and user’s windows management style. International Journal of Human-Computer Interaction 33, 3 (Mar 2017), 190--198. DOI:https://doi.org/10.1080/10447318.2016.1231392Google ScholarCross Ref
- Lars Lischke, Sven Mayer, Katrin Wolf, Niels Henze, Harald Reiterer, and Albrecht Schmidt. 2016. Screen arrangements and interaction areas for large display work places. In Proceedings of the 5th ACM International Symposium on Pervasive Displays (PerDis’16). 228--234. DOI:https://doi.org/10.1145/2914920.2915027Google ScholarDigital Library
- Logitech, Inc. 2019. Microsoft and Logitech MR keyboard SDK. Retrieved from https://github.com/Logitech/labs_mrkeyboard_sdk.Google Scholar
- Gloria Mark, Daniela Gudith, and Ulrich Klocke. 2008. The cost of interrupted work: More speed and stress. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 107--110. DOI:https://doi.org/10.1145/1357054.1357072Google ScholarDigital Library
- Mark McGill, Alexander Ng, and Stephen A. Brewster. 2017. How visual motion cues can influence sickness for in-car VR. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA’17). ACM, New York, NY, 469--469. DOI:https://doi.org/10.1145/3027063.3049790Google Scholar
- Mark McGill, John H. Williamson, and Stephen Brewster. 2016. Examining the role of smart TVs and VR HMDs in synchronous at-a-distance media consumption. ACM Transactions on Computer-Human Interaction 23, 5 (2016), 1--57. DOI:https://doi.org/10.1145/2983530Google ScholarDigital Library
- Chris McKenzie and Adam Glazier. 2017. Designing screen interfaces for VR. Retrieved from https://www.youtube.com/watch?v=ES9jArHRFHQ.Google Scholar
- Microsoft. 2017. Mixed Reality Design. Retrieved from https://developer.microsoft.com/en-us/windows/mixed-reality/design.Google Scholar
- Microsoft. 2019. HoloLens 2. Retrieved from https://www.microsoft.com/en-gb/hololens.Google Scholar
- Paul Milgram and Fumio Kishino. 1994. A taxonomy of mixed reality visual displays. IEICE Transactions on Information and Systems 77, 12 (1994), 1321--1329. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.102.4646.Google Scholar
- Scott Mitchell. 2010. Two Monitors are Better than One, But are Three Better than Two? Retrieved from http://scottonwriting.net/sowblog/archive/2008/07/10/163293.aspxGoogle Scholar
- Miguel A. Nacenta, Carl Gutwin, Dzmitry Aliakseyeu, and Sriram Subramanian. 2009. There and back again: Cross-display object movement in multi-display environments. Human--Computer Interaction 24, 1-2 (2009), 170--229. DOI:https://doi.org/10.1080/07370020902819882Google ScholarCross Ref
- Miguel A. Nacenta, Regan L. Mandryk, and Carl Gutwin. 2008. Targeting across displayless space. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’08). ACM, New York, NY, 777--786. DOI:https://doi.org/10.1145/1357054.1357178Google ScholarDigital Library
- Timothy Neate, Matt Jones, and Michael Evans. 2017. Cross-device media: A review of second screening and multi-device television. Personal and Ubiquitous Computing 21, 2 (Apr 2017), 391--405. DOI:https://doi.org/10.1007/s00779-017-1016-2Google ScholarDigital Library
- Ashish D. Nimbarte, Rabab T. Alabdulmohsen, Steve E. Guffey, and John R. Etherton. 2013. The impact of use of dual monitor screens on 3D head-neck posture and activity of neck muscles. IIE Transactions on Occupational Ergonomics and Human Factors 1, 1 (Jan 2013), 38--49. DOI:https://doi.org/10.1080/21577323.2012.667051Google ScholarCross Ref
- Justin W. Owens, Jennifer Teves, Bobby Nguyen, Amanda Smith, Mandy C. Phelps, and Barbara S. Chaparro. 2012. Examination of dual vs. single monitor use during common office tasks. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 56, 1 (2012), 1506--1510. DOI:https://doi.org/10.1177/1071181312561299Google Scholar
- Sungryul Park, Donghee Choi, Jihhyeon Yi, Seungbae Songil Lee, Ja Eun Lee, Byeonghwa Choi, Seungbae Songil Lee, and Gyouhyung Kyung. 2017. Effects of display curvature, display zone, and task duration on legibility and visual fatigue during visual search task. Applied Ergonomics 60 (Apr 2017), 183--193. DOI:https://doi.org/10.1016/j.apergo.2016.11.012Google Scholar
- Gunnel Peterson, David Nilsson, Johan Trygg, Deborah Falla, Åsa Dedering, Thorne Wallman, and Anneli Peolsson. 2015. Novel insights into the interplay between ventral neck muscles in individuals with whiplash-associated disorders. Scientific Reports 2015, 5 (2015), 15289. DOI:https://doi.org/10.1038/srep15289Google ScholarCross Ref
- Phyllida. 2017. Multiscreens VR. Retrieved from store.steampowered.com/app/512400/Multiscreens/.Google Scholar
- Herbert L. Pick Jr, John J. Rieser, Douglas Wagner, and Anne E. Garing. 1999. The recalibration of rotational locomotion.Journal of Experimental Psychology: Human Perception and Performance 25, 5 (1999), 1179--1188. DOI:https://doi.org/10.1037/0096-1523.25.5.1179Google ScholarCross Ref
- Kathrin Probst, David Lindlbauer, Florian Perteneder, Michael Haller, Bernhard Schwartz, and Andreas Schrempf. 2013. Exploring the use of distributed multiple monitors within an activity-promoting sit-and-stand office workspace. In Proceedings of the Human-Computer Interaction (INTERACT’13). 476--493. Retrieved from https://link.springer.com/chapter/10.1007/978-3-642-40477-1_30.Google ScholarCross Ref
- Pygmal Technologies. 2017. SPACE. Retrieved from https://getspace.io/.Google Scholar
- Roman Rädle, Hans-Christian Jetter, Simon Butscher, and Harald Reiterer. 2013. The effect of egocentric body movements on users’ navigation performance and spatial memory in zoomable user interfaces. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (ITS’13). 23--32. DOI:https://doi.org/10.1145/2512349.2512811Google ScholarDigital Library
- Kari-Jouko Räihä and Oleg Špakov. 2009. Disambiguating Ninja cursors with eye gaze. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’09). ACM, New York, NY, 1411--1414. DOI:https://doi.org/10.1145/1518701.1518913Google ScholarDigital Library
- Umar Rashid, Miguel A. Nacenta, and Aaron Quigley. 2012. Factors influencing visual attention switch in multi-display user interfaces. In Proceedings of the 2012 International Symposium on Pervasive Displays (PerDis’12). 1--6. DOI:https://doi.org/10.1145/2307798.2307799Google ScholarDigital Library
- Sharif Razzaque, Zachariah Kohn, and Mary C. Whitton. 2001. Redirected walking. In Proceedings of the Eurographics 2001 - Short Presentations. Eurographics Association. DOI:https://doi.org/10.2312/egs.20011036Google Scholar
- Mikkel Rønne Jakobsen and Kasper Hornbæk. 2011. Sizing up visualizations. In Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems (CHI’11). ACM Press, New York, New York, 1451. DOI:https://doi.org/10.1145/1978942.1979156Google ScholarDigital Library
- Johnny Saldaña. 2015. The Coding Manual for Qualitative Researchers. Sage.Google Scholar
- Samsung.com. 2018. Samsung Odyssey Mixed Reality HMD. Retrieved from https://www.samsung.com/us/computing/hmd/windows-mixed-reality/xe800zaa-hc1us-xe800zaa-hc1us/.Google Scholar
- Joey Scarr, Andy Cockburn, and Carl Gutwin. 2012. Supporting and exploiting spatial memory in user interfaces. Foundations and Trends in Human-Computer Interaction 6, 1 (2012), 1--84. DOI:https://doi.org/10.1561/1100000046Google ScholarDigital Library
- Marcos Serrano, Barrett Ens, Xing-Dong Yang, and Pourang Irani. 2015. Gluey: Developing a head-worn display interface to unify the interaction experience in distributed display environments. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI’15). ACM, New York, NY, 161--171. DOI:https://doi.org/10.1145/2785830.2785838Google ScholarDigital Library
- Frank M. Shipman, Catherine C. Marshall, and Thomas P. Moran. 1995. Finding and using implicit structure in human-organized spatial layouts of information. In Proceedings of the International Conference on Human Factors in Computing Systems (CHI’95). 346--353. DOI:https://doi.org/10.1145/223904.223949Google Scholar
- Lauren Shupp, Christopher Andrews, Margaret Dickey-Kurdziolek, Beth Yost, and Chris North. 2009. Shaping the display of the future: The effects of display size and curvature on user performance and insights. Human-Computer Interaction 24, 1-2 (Apr 2009), 230--272. DOI:https://doi.org/10.1080/07370020902739429Google ScholarCross Ref
- Kate Sparks, Brian Faragher, and Cary L. Cooper. 2001. Well-being and occupational health in the 21st century workplace. Journal of Occupational and Organizational Psychology 74, 4 (2001), 489--509.Google ScholarCross Ref
- Maximilian Speicher, Brian D. Hall, and Michael Nebeling. 2019. What is mixed reality? In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI’19). ACM Press, New York, New York, 1--15. DOI:https://doi.org/10.1145/3290605.3300767Google ScholarDigital Library
- Matthew J. Stainer, Kenneth C. Scott-Brown, Benjamin W. Tatler, and Kenneth C. Scott-Brown. 2017. On the factors causing processing difficulty of multiple-scene displays. i-Perception 8, 2 (2017). DOI:https://doi.org/10.1177/2041669516689572Google Scholar
- Ramona E. Su and Brian P. Bailey. 2005. Put them where? Towards guidelines for positioning large displays in interactive workspaces. In Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction.337--349. DOI:https://doi.org/10.1007/11555261_29Google Scholar
- Grace P. Y. Szeto, Carey C. Y. Chan, Simon K. M. Chan, H. Y. Lai, and Emily P. Y. Lau. 2014. The effects of using a single display screen versus dual screens on neck-shoulder muscle activity during computer tasks. International Journal of Industrial Ergonomics 44, 3 (May 2014), 460--465. DOI:https://doi.org/10.1016/j.ergon.2014.01.003Google ScholarCross Ref
- Kazuki Takashima, Takafumi Oyama, Yusuke Asari, Ehud Sharlin, Saul Greenberg, and Yoshifumi Kitamura. 2016. Study and design of a shape-shifting wall display. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS’16). ACM, New York, NY, 796--806. DOI:https://doi.org/10.1145/2901790.2901892Google ScholarDigital Library
- Desney Tan and Mary Czerwinski. 2003. Effects of visual separation and physical discontinuities when distributing information across multiple displays. In Proceedings of the IFIP TC13 International Conference on Human-Computer Interaction (Interact’03). 252--259. Retrieved from http://research.microsoft.com/en-us/um/people/desney/publications/interact2003short-visualseparation.pdf.Google Scholar
- Desney Tan, Darren Gergle, Peter Scupelli, and Randy Pausch. 2006. Physically large displays improve performance on spatial tasks. ACM Transactions on Computer-Human Interaction 13, 1 (2006), 71--99. DOI:https://doi.org/10.1145/1143518.1143521Google ScholarDigital Library
- Tao Ni, Greg S. Schmidt, Oliver G. Staadt, Mark A. Livingston, Robert Ball, and Richard May. 2006. A survey of large high-resolution display technologies, techniques, and applications. In Proceedings of the IEEE Virtual Reality Conference (VR’06). IEEE, 223--236. DOI:https://doi.org/10.1109/VR.2006.20Google ScholarDigital Library
- Varjo Technologies. 2019. Varjo VR-2. Retrieved from https://varjo.com/products/vr-2/.Google Scholar
- The Data Visualisation Catalogue. 2019. Density Plot. Retrieved from https://datavizcatalogue.com/methods/density_plot.html.Google Scholar
- Alvin R. Tilley and Henry Dreyfuss Associates. 2002. The Measure of Man and Woman: Human Factors in Design. John Wiley 8 Sons.Google Scholar
- Simon Voelker, Andrii Matviienko, Johannes Schöning, and Jan Borchers. 2015. Combining direct and indirect touch input for interactive workspaces using gaze input. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction (SUI’15). ACM, New York, NY, 79--88. DOI:https://doi.org/10.1145/2788940.2788949Google ScholarDigital Library
- James Walker. 2017. Improving Everyday Computing Tasks with Head-mounted Displays. Ph.D. Dissertation. Michigan Technological University. Retrieved from http://digitalcommons.mtu.edu/etdr/388.Google Scholar
- Jim Wallace, Vicki Ha, Ryder Ziola, and Kori Inkpen. 2006. Swordfish: User tailored workspaces in multi-display environments. In Proceedings of the CHI’06 Extended Abstracts on Human Factors in Computing Systems.1487 pages. DOI:https://doi.org/10.1145/1125451.1125724Google ScholarDigital Library
- James R. Wallace, Nancy Iskander, and Edward Lank. 2016. Creating your bubble: Personal space on and around large public displays. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 2087--2092. DOI:https://doi.org/10.1145/2858036.2858118Google ScholarDigital Library
- Andrew Warr, Ed H. Chi, Helen Harris, Alexander Kuscher, Jenn Chen, Robert Flack, and Nicholas Jitkoff. 2016. Window shopping: A study of desktop window switching. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 3335--3338. DOI:https://doi.org/10.1145/2858036.2858526Google ScholarDigital Library
- Betsy Williams, Gayathri Narasimham, Bjoern Rump, Timothy P. McNamara, Thomas H. Carr, John Rieser, and Bobby Bodenheimer. 2007. Exploring large virtual environments with an HMD when physical space is limited. In Proceedings of the 4th Symposium on Applied Perception in Graphics and Visualization (APGV’07). ACM Press, New York, New York, 41. DOI:https://doi.org/10.1145/1272582.1272590Google ScholarDigital Library
- Julie R. Williamson, Mark McGill, and Khari Outram. 2019. PlaneVR: Social acceptability of virtual reality for aeroplane passengers. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI’19). ACM, New York, NY, Article 80, 14 pages. DOI:https://doi.org/10.1145/3290605.3300310Google ScholarDigital Library
- Hanno Wirtz, Jan Rüth, Martin Serror, Jó Ágila Bitsch Link, and Klaus Wehrle. 2014. Opportunistic interaction in the challenged internet of things. In Proceedings of the 9th ACM MobiCom Workshop on Challenged Networks (CHANTS’14). 7--12. DOI:https://doi.org/10.1145/2645672.2645679Google ScholarDigital Library
- Viktoria Witka. 2016. Perceptual Issues in Multi-Display Environments. Technical Report. Retrieved from http://www.eislab.fim.uni-passau.de/files/publications/2016/mmd_aies2016.pdf#page=23.Google Scholar
- Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The aligned rank transform for nonparametric factorial analyses using only anova procedures. In Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems (CHI’11). ACM Press, New York, New York, 143. DOI:https://doi.org/10.1145/1978942.1978963Google Scholar
- Hoi Chi Woo, Peter. White, and Christopher W. K. Lai. 2016. Ergonomics standards and guidelines for computer workstation design and the impact on users’ health - A review. Ergonomics 59, 3 (mar 2016), 464--475. DOI:https://doi.org/10.1080/00140139.2015.1076528Google ScholarCross Ref
- Shumin Zhai, Carlos Morimoto, and Steven Ihde. 1999. Manual and gaze input cascaded (MAGIC) pointing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’99). ACM, New York, NY, 246--253. DOI:https://doi.org/10.1145/302979.303053Google ScholarDigital Library
- Amanda M. F. Zuniga. 2015. Muscular, Visual and Proprioceptive Outcomes of Computer Work with One versus Two Computer Monitors. Ph.D. Dissertation. Retrieved from http://digitool.library.mcgill.ca/webclient/StreamGate?folder_id=0&dvs==1571847232431956.Google Scholar
Index Terms
- Expanding the Bounds of Seated Virtual Workspaces
Recommendations
Garden: A Mixed Reality Experience Combining Virtual Reality and 3D Reconstruction
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing SystemsGarden is a Mixed Reality (MR) experience that combines both Virtual Reality (VR) and Augmented Reality (AR), and lets players transform their environment into a virtual garden they can play in. This is done by doing both stereoscopic rendering and 3D ...
Captivating the Senses: Crafting a Multisensory Virtual Experience for Enhanced Realism
UbiComp/ISWC '23 Adjunct: Adjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable ComputingThis paper explores the challenges and opportunities in achieving a high level of realism and presence in Virtual Reality (VR) experiences. Realism and presence, which refer to the level of authenticity of the virtual environment and the user’s ...
Through Tinted Eyeglasses
EIC Roy Want introduces the special issue on cross-reality environments and discusses alternate realities including virtual reality, augmented reality, embodied virtuality, cross-reality, and mixed reality.
Comments