Xincheng Huang
Robert Xiao
Skip Abstract Section
Skip Supplemental Material SectionAbstract
Shared Mixed Reality experiences allow two co-located users to collaborate on both physical and digital tasks with familiar social protocols. However, extending the same to remote collaboration is limited by cumbersome setups for aligning distinct physical environments and the lack of access to remote physical artifacts. We present SurfShare, a general-purpose symmetric remote collaboration system with mixed-reality head-mounted displays (HMDs). Our system shares a spatially consistent physical-virtual workspace between two remote users, anchored on a physical plane in each environment (e.g., a desk or wall). The video feed of each user's physical surface is overlaid virtually on the other side, creating a shared view of the physical space. We integrate the physical and virtual workspace through virtual replication. Users can transmute physical objects to the virtual space as virtual replicas. Our system is lightweight, implemented using only the capabilities of the headset, without requiring any modifications to the environment (e.g. cameras or motion tracking hardware). We discuss the design, implementation, and interaction capabilities of our prototype, and demonstrate the utility of SurfShare through four example applications. In a user experiment with a comprehensive prototyping task, we found that SurfShare provides a physical-virtual workspace that supports low-fi prototyping with flexible proxemics and fluid collaboration dynamics.
Supplemental Material
Available for Download
zip
huang.zip (216.7 MB)
Supplemental movie, appendix, image and software files for, SurfShare: Lightweight Spatially Consistent Physical Surface and Virtual Replica Sharing with Head-mounted Mixed-Reality
- Matt Adcock, Stuart Anderson, and Bruce Thomas. 2013. RemoteFusion: real time depth camera fusion for remote collaboration on physical tasks. In Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry (Hong Kong, Hong Kong) (VRCAI '13). Association for Computing Machinery, New York, NY, USA, 235--242.Google Scholar
Digital Library
- Maneesh Agrawala, Andrew C Beers, Ian McDowall, Bernd Fröhlich, Mark Bolas, and Pat Hanrahan. 1997. The two-user Responsive Workbench: support for collaboration through individual views of a shared space. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques (SIGGRAPH '97). ACM Press/Addison-Wesley Publishing Co., USA, 327--332.Google ScholarDigital Library
- Deepak Akkil, Jobin Mathew James, Poika Isokoski, and Jari Kangas. 2016. GazeTorch: Enabling Gaze Awareness in Collaborative Physical Tasks. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA '16). Association for Computing Machinery, New York, NY, USA, 1151--1158.Google ScholarDigital Library
- Rahul Arora, Rubaiat Habib Kazi, Tovi Grossman, George Fitzmaurice, and Karan Singh. 2018. SymbiosisSketch: Combining 2D & 3D Sketching for Designing Detailed 3D Objects in Situ. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18, Paper 185). Association for Computing Machinery, New York, NY, USA, 1--15.Google ScholarDigital Library
- Rahul Arora, Rubaiat Habib Kazi, Danny M Kaufman, Wilmot Li, and Karan Singh. 2019. MagicalHands: Mid-Air Hand Gestures for Animating in VR. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST '19). Association for Computing Machinery, New York, NY, USA, 463--477.Google ScholarDigital Library
- Aaron Bangor, Philip Kortum, and James Miller. 2009. Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale. J. Usability Studies 4, 3 (may 2009), 114--123.Google ScholarDigital Library
- Simona Maria Banu. 2012. Augmented Reality system based on sketches for geometry education. In 2012 International Conference on E-Learning and E-Technologies in Education (ICEEE). 166--170.Google ScholarCross Ref
- Sukanya Bhattacharjee and Parag Chaudhuri. 2020. A survey on sketch based content creation: From the desktop to virtual and augmented reality. Comput. Graph. Forum 39, 2 (May 2020), 757--780.Google ScholarCross Ref
- G. Bradski. 2000. The OpenCV Library. Dr. Dobb's Journal of Software Tools (2000).Google Scholar
- Bill Buxton. 2009. Mediaspace -- Meaningspace -- Meetingspace. In Computer Supported Cooperative Work. Springer London, London, 217--231.Google Scholar
- Minghao Cai, Soh Masuko, and Jiro Tanaka. 2018. Shopping Together: A Remote Co-shopping System Utilizing Spatial Gesture Interaction. In Human-Computer Interaction. Interaction Technologies. Springer International Publishing, 219--232.Google Scholar
- Minghao Cai and Jiro Tanaka. 2017. Trip Together: A Remote Pair Sightseeing System Supporting Gestural Communication. In Proceedings of the 5th International Conference on Human Agent Interaction (Bielefeld, Germany) (HAI '17). Association for Computing Machinery, New York, NY, USA, 317--324.Google ScholarDigital Library
- Long Chen and Jin-Chao Xu. 2004. OPTIMAL DELAUNAY TRIANGULATIONS. J. Comput. Math. 22, 2 (2004), 299--308.Google Scholar
- Tobias Drey, Jessica Janek, Josef Lang, Dietmar Puschmann, Michael Rietzler, and Enrico Rukzio. 2022. SpARklingPaper: Enhancing Common Pen- And Paper-Based Handwriting Training for Children by Digitally Augmenting Papers Using a Tablet Screen. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 3, Article 113 (sep 2022), 29 pages. https://doi.org/10.1145/3550337Google ScholarDigital Library
- Carmine Elvezio, Mengu Sukan, Ohan Oda, Steven Feiner, and Barbara Tversky. 2017. Remote collaboration in AR and VR using virtual replicas. In ACM SIGGRAPH 2017 VR Village (Los Angeles, California) (SIGGRAPH '17, Article 13). Association for Computing Machinery, New York, NY, USA, 1--2.Google ScholarDigital Library
- Barrett Ens, Sarah Goodwin, Arnaud Prouzeau, Fraser Anderson, Florence Y Wang, Samuel Gratzl, Zac Lucarelli, Brendan Moyle, Jim Smiley, and Tim Dwyer. 2021. Uplift: A Tangible and Immersive Tabletop System for Casual Collaborative Visual Analytics. IEEE Trans. Vis. Comput. Graph. 27, 2 (Feb. 2021), 1193--1203.Google ScholarCross Ref
- Allen J Fairchild, Simon P Campion, Arturo S García, Robin Wolff, Terrence Fernando, and David J Roberts. 2017. A Mixed Reality Telepresence System for Collaborative Space Operation. IEEE Trans. Circuits Syst. Video Technol. 27, 4 (April 2017), 814--827.Google ScholarDigital Library
- Daniel Immanuel Fink, Johannes Zagermann, Harald Reiterer, and Hans-Christian Jetter. 2022. Re-Locations: Augmenting Personal and Shared Workspaces to Support Remote Collaboration in Incongruent Spaces. Proc. ACM Hum.-Comput. Interact. 6, ISS, Article 556 (nov 2022), 30 pages. https://doi.org/10.1145/3567709Google ScholarDigital Library
- Susan R Fussell, Leslie D Setlock, Jie Yang, Jiazhi Ou, Elizabeth Mauer, and Adam D I Kramer. 2004. Gestures over video streams to support remote collaboration on physical tasks. Hum.-Comput. Interact. 19, 3 (Sept. 2004), 273--309.Google ScholarDigital Library
- Danilo Gasques, Janet G Johnson, Tommy Sharkey, Yuanyuan Feng, Ru Wang, Zhuoqun Robin Xu, Enrique Zavala, Yifei Zhang, Wanze Xie, Xinming Zhang, Konrad Davis, Michael Yip, and Nadir Weibel. 2021. ARTEMIS: A Collaborative Mixed-Reality System for Immersive Surgical Telementoring. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI '21, Article 662). Association for Computing Machinery, New York, NY, USA, 1--14.Google ScholarDigital Library
- Jens Emil Grønbæk, Henrik Korsgaard, Marianne Graves Petersen, Morten Henriksen Birk, and Peter Gall Krogh. 2017. Proxemic Transitions: Designing Shape-Changing Furniture for Informal Meetings. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 7029--7041. https://doi.org/10.1145/3025453.3025487Google ScholarDigital Library
- Jens Emil Granbæk, Majken Kirkegaard Rasmussen, Kim Halskov, and Marianne Graves Petersen. 2020. KirigamiTable: Designing for Proxemic Transitions with a Shape-Changing Tabletop. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--15. https://doi.org/10.1145/3313831.3376834Google ScholarDigital Library
- Jens Emil Sloth Grønbæk, Ken Pfeuffer, Eduardo Velloso, Morten Astrup, Melanie Isabel Sønderkær Pedersen, Martin Kjær, Germán Leiva, and Hans Gellersen. 2023. Partially Blended Realities: Aligning Dissimilar Spaces for Distributed Mixed Reality Meetings. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI '23). Association for Computing Machinery, New York, NY, USA, Article 456, 16 pages. https://doi.org/10.1145/3544548.3581515Google ScholarDigital Library
- Anhong Guo, Ilter Canberk, Hannah Murphy, Andrés Monroy-Hernández, and Rajan Vaish. 2019. Blocks: Collaborative and Persistent Augmented Reality Experiences. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3 (Sept. 2019), 1--24.Google ScholarDigital Library
- Pavel Gurevich, Joel Lanir, Benjamin Cohen, and Ran Stone. 2012. TeleAdvisor: a versatile augmented reality tool for remote assistance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). Association for Computing Machinery, New York, NY, USA, 619--622.Google ScholarDigital Library
- Carl Gutwin and Saul Greenberg. 2002. A Descriptive Framework of Workspace Awareness for Real-Time Groupware. Comput. Support. Coop. Work 11, 3 (Sept. 2002), 411--446.Google ScholarDigital Library
- Steven Henderson and Steven Feiner. 2011. Exploring the benefits of augmented reality documentation for maintenance and repair. IEEE Trans. Vis. Comput. Graph. 17, 10 (Oct. 2011), 1355--1368.Google ScholarDigital Library
- Jaylin Herskovitz, Yi Fei Cheng, Anhong Guo, Alanson P. Sample, and Michael Nebeling. 2022. XSpace: An Augmented Reality Toolkit for Enabling Spatially-Aware Distributed Collaboration. Proc. ACM Hum.-Comput. Interact. 6, ISS, Article 568 (nov 2022), 26 pages. https://doi.org/10.1145/3567721Google ScholarDigital Library
- Donald M Hilty, Karan Randhawa, Marlene M Maheu, Alastair J S McKean, Richard Pantera, Matthew C Mishkind, and Albert "skip" Rizzo. 2020. A Review of Telepresence, Virtual Reality, and Augmented Reality Applied to Clinical Care. Journal of Technology in Behavioral Science 5, 2 (June 2020), 178--205.Google Scholar
- Xincheng Huang, James Riddell, and Robert Xiao. 2023. Virtual Reality Telepresence: 360-Degree Video Streaming with Edge-Compute Assisted Static Foveated Compression. IEEE Transactions on Visualization and Computer Graphics 29, 11 (2023), 4525--4534. https://doi.org/10.1109/TVCG.2023.3320255Google ScholarCross Ref
- Hiroshi Ishii and Minoru Kobayashi. 1992. ClearBoard: a seamless medium for shared drawing and conversation with eye contact. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Monterey, California, USA) (CHI '92). Association for Computing Machinery, New York, NY, USA, 525--532.Google ScholarDigital Library
- Daisuke Iwai, Ryo Matsukage, Sota Aoyama, Tsuyoshi Kikukawa, and Kosuke Sato. 2018. Geometrically Consistent Projection-Based Tabletop Sharing for Remote Collaboration. IEEE Access 6 (2018), 6293--6302.Google ScholarCross Ref
- Pascal Jansen, Fabian Fischbach, Jan Gugenheimer, Evgeny Stemasov, Julian Frommel, and Enrico Rukzio. 2020. ShARe: Enabling Co-Located Asymmetric Multi-User Interaction for Augmented Reality Head-Mounted Displays. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, New York, NY, USA, 459--471.Google ScholarDigital Library
- Michal Joachimczak, Juan Liu, and Hiroshi Ando. 2017. Real-time mixed-reality telepresence via 3D reconstruction with HoloLens and commodity depth sensors. In Proceedings of the 19th ACM International Conference on Multimodal Interaction (Glasgow, UK) (ICMI '17). Association for Computing Machinery, New York, NY, USA, 514--515.Google ScholarDigital Library
- Sasa Junuzovic, Kori Inkpen, Tom Blank, and Anoop Gupta. 2012. IllumiShare: sharing any surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). Association for Computing Machinery, New York, NY, USA, 1919--1928.Google ScholarDigital Library
- P KaewTraKulPong and R Bowden. 2002. An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection. 135--144 pages.Google Scholar
- Shunichi Kasahara and Jun Rekimoto. 2015. JackIn head: immersive visual telepresence system with omnidirectional wearable camera for remote collaboration. In Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology (Beijing, China) (VRST '15). Association for Computing Machinery, New York, NY, USA, 217--225. https://doi.org/10.1145/2821592.2821608Google ScholarDigital Library
- Adam Kendon. 2010. Spacing and Orientation in Co-present Interaction. In Development of Multimodal Interfaces: Active Listening and Synchrony: Second COST 2102 International Training School, Dublin, Ireland, March 23-27, 2009, Revised Selected Papers, Anna Esposito, Nick Campbell, Carl Vogel, Amir Hussain, and Anton Nijholt (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 1--15. https://doi.org/10.1007/978-3-642-12397-9_1Google ScholarDigital Library
- Dooyoung Kim, Jae-Eun Shin, Jeongmi Lee, and Woontack Woo. 2021. Adjusting Relative Translation Gains According to Space Size in Redirected Walking for Mixed Reality Mutual Space Generation. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 653--660.Google Scholar
- Joel Lanir, Ran Stone, Benjamin Cohen, and Pavel Gurevich. 2013. Ownership and control of point of view in remote assistance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI '13). Association for Computing Machinery, New York, NY, USA, 2243--2252.Google ScholarDigital Library
- Paulett Lara. 2020. The Hidden Dimension - Edward hall. (Aug. 2020). https://www.academia.edu/43785083/The_Hidden_Dimension_Edward_HallGoogle Scholar
- Nicolas H Lehment, Daniel Merget, and Gerhard Rigoll. 2014. Creating automatically aligned consensus realities for AR videoconferencing. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 201--206.Google ScholarCross Ref
- Germán Leiva, Cuong Nguyen, Rubaiat Habib Kazi, and Paul Asente. 2020. Pronto: Rapid Augmented Reality Video Prototyping Using Sketches and Enaction. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--13.Google ScholarDigital Library
- Paul Luff and Christian Heath. 1998. Mobility in Collaboration. In Proceedings of the 1998 ACM Conference on Computer Supported Cooperative Work (Seattle, Washington, USA) (CSCW '98). Association for Computing Machinery, New York, NY, USA, 305--314. https://doi.org/10.1145/289444.289505Google ScholarDigital Library
- Mille Skovhus Lunding, Jens Emil Sloth Grønbæk, Karl-Emil Kjær Bilstrup, Marie-Louise Stisen Kjerstein Sørensen, and Marianne Graves Petersen. 2022. ExposAR: Bringing Augmented Reality to the Computational Thinking Agenda through a Collaborative Authoring Tool. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI '22, Article 131). Association for Computing Machinery, New York, NY, USA, 1--14.Google ScholarDigital Library
- Yuhao Ma, Joshua Ferguson, Kevin Jonaitis, Kyle Boos, and Donald Patterson. 2014. Collaborative Geometry-Aware Augmented Reality with Depth Sensors. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication (Seattle, Washington) (UbiComp '14 Adjunct). Association for Computing Machinery, New York, NY, USA, 251--254. https://doi.org/10.1145/2638728.2638765Google ScholarDigital Library
- Ryo Matsukage, Daisuke Iwai, and Kosuke Sato. 2015. Consistent desktop sharing based on document coordinate system for face-to-face online meeting. In SIGGRAPH Asia 2015 Emerging Technologies (Kobe, Japan) (SA '15, Article 6). Association for Computing Machinery, New York, NY, USA, 1--2.Google Scholar
- Paul Milgram and Fumio Kishino. 1994. A Taxonomy of Mixed Reality Visual Displays. IEICE Trans. Information Systems vol. E77-D, no. 12 (12 1994), 1321--1329.Google Scholar
- Paul Milgram, Haruo Takemura, Akira Utsumi, and Fumio Kishino. 1994. Augmented reality: A class of displays on the reality-virtuality continuum. Telemanipulator and Telepresence Technologies 2351 (01 1994). https://doi.org/10.1117/12.197321Google ScholarCross Ref
- Meredith Ringel Morris, Jarrod Lombardo, and Daniel Wigdor. 2010. WeSearch: supporting collaborative search and sensemaking on a tabletop display. In Proceedings of the 2010 ACM conference on Computer supported cooperative work (Savannah, Georgia, USA) (CSCW '10). Association for Computing Machinery, New York, NY, USA, 401--410.Google ScholarDigital Library
- Oleg R Musin. 1997. Properties of the Delaunay triangulation. In Proceedings of the thirteenth annual symposium on Computational geometry (Nice, France) (SCG '97). Association for Computing Machinery, New York, NY, USA, 424--426.Google ScholarDigital Library
- Michael Nebeling, Katy Lewis, Yu-Cheng Chang, Lihan Zhu, Michelle Chung, Piaoyang Wang, and Janet Nebeling. 2020. XRDirector: A Role-Based Collaborative Immersive Authoring System. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--12.Google ScholarDigital Library
- Michael Nebeling and Katy Madier. 2019. 360proto: Making Interactive Virtual Reality & Augmented Reality Prototypes from Paper. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--13.Google ScholarDigital Library
- Michael Nebeling, Janet Nebeling, Ao Yu, and Rob Rumble. 2018. ProtoAR: Rapid Physical-Digital Prototyping of Mobile Augmented Reality Applications. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--12.Google ScholarDigital Library
- Michael Nebeling, Shwetha Rajaram, Liwei Wu, Yifei Cheng, and Jaylin Herskovitz. 2021. XRStudio: A Virtual Production and Live Streaming System for Immersive Instructional Experiences. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI '21, Article 107). Association for Computing Machinery, New York, NY, USA, 1--12.Google ScholarDigital Library
- Ohan Oda, Carmine Elvezio, Mengu Sukan, Steven Feiner, and Barbara Tversky. 2015. Virtual Replicas for Remote Assistance in Virtual and Augmented Reality. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (Charlotte, NC, USA) (UIST '15). Association for Computing Machinery, New York, NY, USA, 405--415. https://doi.org/10.1145/2807442.2807497Google ScholarDigital Library
- Dan R. Olsen. 2007. Evaluating User Interface Systems Research. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (Newport, Rhode Island, USA) (UIST '07). Association for Computing Machinery, New York, NY, USA, 251--258. https://doi.org/10.1145/1294211.1294256Google ScholarDigital Library
- Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L Davidson, Sameh Khamis, Mingsong Dou, Vladimir Tankovich, Charles Loop, Qin Cai, Philip A Chou, Sarah Mennicken, Julien Valentin, Vivek Pradeep, Shenlong Wang, Sing Bing Kang, Pushmeet Kohli, Yuliya Lutchyn, Cem Keskin, and Shahram Izadi. 2016. Holoportation: Virtual 3D Teleportation in Real-time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST '16). Association for Computing Machinery, New York, NY, USA, 741--754.Google ScholarDigital Library
- Riccardo Palmarini, Iñigo Fernández Del Amo, Dedy Ariansyah, Samir Khan, John Ahmet Erkoyuncu, and Rajkumar Roy. 2023. Fast Augmented Reality Authoring: Fast Creation of AR step-by-step Procedures for Maintenance Operations. IEEE Access (2023), 1--1.Google Scholar
- L Paul Chew. 1989. Constrained delaunay triangulations. Algorithmica 4, 1 (June 1989), 97--108.Google Scholar
- Tomislav Pejsa, Julian Kantor, Hrvoje Benko, Eyal Ofek, and Andrew Wilson. 2016. Room2Room: Enabling Life-Size Telepresence in a Projected Augmented Reality Environment. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (San Francisco, California, USA) (CSCW '16). Association for Computing Machinery, New York, NY, USA, 1716--1725.Google ScholarDigital Library
- Thammathip Piumsomboon, Gun A Lee, Andrew Irlitti, Barrett Ens, Bruce H Thomas, and Mark Billinghurst. 2019. On the Shoulder of the Giant: A Multi-Scale Mixed Reality Collaboration with 360 Video Sharing and Tangible Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--17.Google ScholarDigital Library
- Kazuki Takashima, Takafumi Oyama, Yusuke Asari, Ehud Sharlin, Saul Greenberg, and Yoshifumi Kitamura. 2016. Study and Design of a Shape-Shifting Wall Display. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (Brisbane, QLD, Australia) (DIS '16). Association for Computing Machinery, New York, NY, USA, 796--806. https://doi.org/10.1145/2901790.2901892Google ScholarDigital Library
- Franco Tecchia, Leila Alem, and Weidong Huang. 2012. 3D helping hands: a gesture based MR system for remote collaboration. In Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (Singapore, Singapore) (VRCAI '12). Association for Computing Machinery, New York, NY, USA, 323--328.Google ScholarDigital Library
- Balasaravanan Thoravi Kumaravel, Fraser Anderson, George Fitzmaurice, Bjoern Hartmann, and Tovi Grossman. 2019. Loki: Facilitating Remote Instruction of Physical Tasks Using Bi-Directional Mixed-Reality Telepresence. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST '19). Association for Computing Machinery, New York, NY, USA, 161--174.Google ScholarDigital Library
- Peng Wang, Shusheng Zhang, Xiaoliang Bai, Mark Billinghurst, Weiping He, Mengmeng Sun, Yongxing Chen, Hao Lv, and Hongyu Ji. 2019. 2.5DHANDS: a gesture-based MR remote collaborative platform. Int. J. Adv. Manuf. Technol. 102, 5 (June 2019), 1339--1353.Google ScholarCross Ref
- Haijun Xia, Sebastian Herscher, Ken Perlin, and Daniel Wigdor. 2018. Spacetime: Enabling Fluid Individual and Collaborative Editing in Virtual Reality. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST '18). Association for Computing Machinery, New York, NY, USA, 853--866.Google ScholarDigital Library
- Robert Xiao, Scott Hudson, and Chris Harrison. 2017. Supporting Responsive Cohabitation Between Virtual Interfaces and Physical Objects on Everyday Surfaces. Proc. ACM Hum.-Comput. Interact. 1, EICS (June 2017), 1--17.Google ScholarDigital Library
- Leonard Yoon, Dongseok Yang, Choongho Chung, and Sung-Hee Lee. 2021. A Full Body Avatar-Based Telepresence System for Dissimilar Spaces. arXiv:2103.04380 [cs.HC]Google Scholar
- Leonard Yoon, Dongseok Yang, Jaehyun Kim, ChoongHo Chung, and Sung-Hee Lee. 2022. Placement Retargeting of Virtual Avatars to Dissimilar Indoor Environments. IEEE Transactions on Visualization and Computer Graphics 28, 3 (2022), 1619--1633. https://doi.org/10.1109/TVCG.2020.3018458Google ScholarCross Ref
- Jacob Young, Tobias Langlotz, Steven Mills, and Holger Regenbrecht. 2020. Mobileportation: Nomadic Telepresence for Mobile Devices. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 2, Article 65 (jun 2020), 16 pages. https://doi.org/10.1145/3397331Google ScholarDigital Library
- Kevin Yu, Alexander Winkler, Frieder Pankratz, Marc Lazarovici, Dirk Wilhelm, Ulrich Eck, Daniel Roth, and Nassir Navab. 2021. Magnoramas: Magnifying Dioramas for Precise Annotations in Asymmetric 3D Teleconsultation. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 392--401.Google Scholar
- Fengyuan Zhu and Tovi Grossman. 2020. BISHARE: Exploring Bidirectional Interactions Between Smartphones and Head-Mounted Augmented Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--14.Google ScholarDigital Library
- Jakob Zillner, Christoph Rhemann, Shahram Izadi, and Michael Haller. 2014. 3D-board: a whole-body remote collaborative whiteboard. In Proceedings of the 27th annual ACM symposium on User interface software and technology (Honolulu, Hawaii, USA) (UIST '14). Association for Computing Machinery, New York, NY, USA, 471--479.Google ScholarDigital Library
- Z Zivkovic. 2004. Improved adaptive Gaussian mixture model for background subtraction. In Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004., Vol. 2. 28--31 Vol.2.Google ScholarCross Ref
Index Terms
- SurfShare: Lightweight Spatially Consistent Physical Surface and Virtual Replica Sharing with Head-mounted Mixed-Reality
Recommendations
Merging environments for shared spaces in mixed reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyIn virtual reality a real walking interface limits the extent of a virtual environment to our local walkable space. As local spaces are specific to each user, sharing a virtual environment with others for collaborative work or games becomes complicated. ...
Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsWe present Mini-Me, an adaptive avatar for enhancing Mixed Reality (MR) remote collaboration between a local Augmented Reality (AR) user and a remote Virtual Reality (VR) user. The Mini-Me avatar represents the VR user's gaze direction and body gestures ...
Snow Dome: A Multi-Scale Interaction in Mixed Reality Remote Collaboration
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing SystemsWe present Snow Dome, a Mixed Reality (MR) remote collaboration application that supports a multi-scale interaction for a Virtual Reality (VR) user. We share a local Augmented Reality (AR) user's reconstructed space with a remote VR user who has an ...
Comments