Alexander Mehler
ABSTRACT
We present VAnnotatoR, a framework for generating so-called multimodal hypertexts. Based on Virtual Reality (VR) and Augmented Reality (AR), VAnnotatoR enables the annotation and linkage of semiotic aggregates (texts, images and their segments) with walk-on-able animations of places and buildings. In this way, spatial locations can be linked, for example, to temporal locations and Discourse Referents (ranging over temporal locations, agents, objects, or instruments etc. of actions) or to texts and images describing or depicting them, respectively. VAnnotatoR represents segments of texts or images, discourse referents and animations as interactive, manipulable 3D objects which can be networked to generate multimodal hypertexts. The paper introduces the underlying model of hyperlinks and exemplifies VAnnotatoR by means of a project in the area of public history, the so-called Stolperwege project.
- Daisy Abbott, Kim Bale, Ramy Gowigati, Douglas Pritchard, and Paul Chapman. 2011. Empire 3D: a Collaborative Semantic Annotation Tool for Virtual Environments Proc. of WORLDCOMP 2011. 121--128.Google Scholar
- Giuseppe Abrami, Michael Freiberg, and Paul Warner. 2015. Managing and Annotating Historical Multimodal Corpora with the eHumanities Desktop. In Historical Corpora: Challenges and Perspectives, Jost Gippert and Ralf Gehrke (Eds.). Narr, 353--363.Google Scholar
- Giuseppe Abrami and Alexander Mehler. 2018. A UIMA Database Interface for Managing NLP-related Text Annotations Proceedings of the 11th edition of the Language Resources and Evaluation Conference, May 7 - 12 (LREC 2018). Miyazaki, Japan.Google Scholar
- Claus Atzenbeck, Thomas Schedel, Manolis Tzagarakis, Daniel Roßner, and Lucas Mages. 2017. Revisiting Hypertext Infrastructure. In Proceedings of the 28th ACM Conference on Hypertext and Social Media (HT '17). ACM, New York, NY, USA, 35--44. Google ScholarDigital Library
- Jon Barwise and John Perry. 1983. Situations and Attitudes. MIT Press, Cambridge.Google Scholar
- C. Berge. 1989. Hypergraphs: Combinatorics of Finite Sets. North Holland, Amsterdam.Google Scholar
- Mark Bernstein. 2009. On Hypertext Narrative. In Proceedings of the 20th ACM Conference on Hypertext and Hypermedia (HT '09). ACM, New York, NY, USA, 5--14. Google ScholarDigital Library
- Doug A. Bowman, Larry F. Hodges, and Jay Bolter. 1998. The Virtual Venue: User-Computer Interaction in Information-Rich Virtual Environments. Presence Vol. 7, 5 (1998), 478--493. Google ScholarDigital Library
- Marc Cavazza and Ian Palmer. 2000. High-level interpretation in virtual environments. Applied Artificial Intelligence Vol. 14, 1 (2000), 125--144.Google ScholarCross Ref
- Fred Charles, Julie Porteous, Marc Cavazza, and Jonathan Teutenberg. 2011. Timeline-based Navigation for Interactive Narratives Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology (ACE '11). ACM, New York, NY, USA, Article 37, 8 pages. Google ScholarDigital Library
- Zhutian Chen, Yifang Wang, Tianchen Sun, Xiang Gao, Wei Chen, Zhigeng Pan, Huamin Qu, and Yingcai Wu. 2017. Exploring the design space of immersive urban analytics. Visual Informatics Vol. 1, 2 (2017), 132--142.Google ScholarCross Ref
- Damien Clergeaud and Pascal Guitton. 2017. Design of an annotation system for taking notes in virtual reality Proc. of 3DTV-CON.Google Scholar
- Grégoire Cliquet, Matthieu Perreira, Fabien Picarougne, Yannick Prié, and Toinon Vigier. 2017. Towards HMD-based Immersive Analytics. In Immersive analytics Workshop, IEEE VIS. https://hal.archives-ouvertes.fr/hal-01631306Google Scholar
- Hugh Davis, Wendy Hall, Ian Heath, Gary Hill, and Rob Wilkins. 1992. Towards an Integrated Information Environment with Open Hypermedia Systems Proceedings of the ACM Conference on Hypertext (ECHT '92). ACM, New York, NY, USA, 181--190. Google ScholarDigital Library
- Andreas Dieberger and Jolanda G. Tromp. 1993. The Information City project -- a virtual reality user interface for navigation in information spaces. In Proceedings of the Symposium Virtual Reality Vienna, Vienna, Dec. 1--3.Google Scholar
- Umberto Eco. 1991. Einführung in die Semiotik. Fink, München.Google Scholar
- Gilles Falquet and Claudine Métral. 2006. Integrating urban knowledge into 3D city models. In Proc. of the 1st Intern. Workshop on Next Generation 3D City Models.Google Scholar
- Jakub Floty'nski and Krzysztof Walczak. 2014. Semantic representation of multi-platform 3D content. Computer Science and Information Systems Vol. 11, 4 (2014), 1555--1580.Google ScholarCross Ref
- Rüdiger Gleim, Alexander Mehler, and Alexandra Ernst. 2012. SOA implementation of the eHumanities Desktop. In Proceedings of the Workshop on Service-oriented Architectures (SOAs) for the Humanities: Solutions and Impacts, Digital Humanities 2012, Hamburg, Germany.Google Scholar
- R. H. Goetschel. 1995. Introduction to fuzzy hypergraphs and Hebbian Structures. Fuzzy Sets and Systems Vol. 76 (1995), 113--130. Google ScholarDigital Library
- T. Götz and O. Suhre. 2004. Design and implementation of the UIMA Common Analysis System. IBM Systems Journal Vol. 43, 3 (2004), 476 --489. Google ScholarDigital Library
- Reid Harmon, Walter Patterson, William Ribarsky, and Jay Bolter. 1996. The Virtual Annotation System. In Proceedings of the IEEE Virtual Reality Annual International Symposium. IEEE, 239--245. Google ScholarDigital Library
- Wahed Hemati, Tolga Uslu, and Alexander Mehler. 2016. TextImager: a Distributed UIMA-based System for NLP Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: System Demonstrations. 59--63.Google Scholar
- Jörn Hurtienne. 2017. How Cognitive Linguistics Inspires HCI: Image Schemas and Image-Schematic Metaphors. International Journal of Human-Computer Interaction Vol. 33, 1 (2017), 1--20.Google ScholarCross Ref
- Rieko Kadobayashi, Julian Lombardi, Mark P. McCahill, Howard Stearns, Katsumi Tanaka, and Alan Kay. 2005. Annotation Authoring in Collaborative 3D Virtual Environments Proc. of ICAT '05. ACM, New York, 255--256. Google ScholarDigital Library
- Jean-Luc Lugrin and Marc Cavazza. 2007. Making sense of virtual environments: action representation, grounding and common sense. In Proceedings of the 12th international conference on Intelligent user interfaces. ACM, 225--234. Google ScholarDigital Library
- Clara Mancini and Simon Buckingham Shum. 2004. Towards 'Cinematic' Hypertext. In Proceedings of the Fifteenth ACM Conference on Hypertext and Hypermedia (HYPERTEXT '04). ACM, New York, NY, USA, 215--224. Google ScholarDigital Library
- Alexander Mehler, Giuseppe Abrami, Steffen Bruendel, Lisa Felder, Thomas Ostertag, and Christian Spiekermann. 2017. Stolperwege: An App for a Digital Public History of the Holocaust Proceedings of the 28th ACM Conference on Hypertext and Social Media (HT '17). ACM, New York, NY, USA, 319--320. Google ScholarDigital Library
- Alexander Mehler, Andy Lücking, and Giuseppe Abrami. 2014. WikiNect: Image Schemata as a Basis of Gestural Writing for Kinetic Museum Wikis. Universal Access in the Information Society (2014), 1--17. Google ScholarDigital Library
- Paul Milgram and Fumio Kishino. 1994. A taxonomy of mixed reality visual displays. IEICE Transactions on Information Systems Vol. 77, 12 (1994), 1321--1329.Google Scholar
- Mark E. J. Newman. 2010. Networks: An Introduction. Oxford University Press. Google ScholarCross Ref
- Frank M. Shipman, III and Catherine C. Marshall. 1999. Spatial Hypertext: An Alternative to Navigational and Semantic Links. ACM Comput. Surv. Vol. 31, 4es, Article 14 (Dec.. 1999). Google ScholarDigital Library
- Lisa M. Snyder. 2014. VSim: Scholarly Annotations in Real-Time 3D Environments Proceedings of DH-CASE '14. ACM, New York, Article 2, 2:1--2:8 pages. Google ScholarDigital Library
- Carlos Solis and Nour Ali. 2011. An Experience Using a Spatial Hypertext Wiki. In Proceedings of the 22Nd ACM Conference on Hypertext and Hypermedia (HT '11). ACM, New York, NY, USA, 133--142. Google ScholarDigital Library
- Michela Spagnuolo and Bianca Falcidieno. 2009. 3D Media and the Semantic Web. IEEE Intelligent Systems Vol. 24, 2 (2009), 90--96. Google ScholarDigital Library
- J. Sweller, P. Ayres, and S. Kalyuga. 2011. Cognitive Load Theory. Springer, New York.Google Scholar
- Polle T. Zellweger. 1989. Scripted Documents. A Hypermedia Path Mechanism. In Proceedings of the Second Annual ACM Conference on Hypertext (HYPERTEXT '89). ACM, New York, 1--14. Google ScholarDigital Library
Index Terms
- VAnnotatoR: A Framework for Generating Multimodal Hypertexts
Recommendations
A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing SystemsWe identify usability challenges facing consumers adopting Virtual Reality (VR) head-mounted displays (HMDs) in a survey of 108 VR HMD users. Users reported significant issues in interacting with, and being aware of their real-world context when using a ...
Immersive virtual aquarium with real-walking navigation
VRCAI '13: Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in IndustryIn this paper, we propose a new immersive virtual aquarium system that comprises enhanced navigation, shared user experience, and manipulation in virtual reality. The system utilizes a large studio that allows users to walk around naturally and operates ...
A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing SystemsThis video presents insights into the usability challenges present in consumer VR Head-Mounted Displays regarding a users' capability to interact with and be aware of reality. We demonstrate how these issues can be overcome through selectively ...
Comments