A multimedia help system for a medical scenario in a rehabilitation clinic

ABSTRACT

In this paper we outline instructional, legal, and software requirements as well as a prototypical software implementation for a multimedia help system in a rehabilitation scenario. The help system will be used by patients in a rehabilitation clinic to support their pelvic floor exercises. After describing the use case we will outline the requirements for the scenario and show how our software was extended to meet the requirements. We present the key features of each component of the SIVA Suite: the authoring tool, the redesigned HTML5 player, and the server application. Thereby, important new features are described and illustrated. Design decisions are presented and explained.

References

1. F. Amadieu, A. Tricot, and C. Marine. Interaction between prior knowledge and concept-map structure on hypertext comprehension, coherence of reading orders and disorientation. Interacting with Computers, 22(2):88--97, 2010.
2. A. Arguel and E. Jamet. Using video and static pictures to improve learning of procedural contents. Computers in Human Behavior, 25(2):354--359, Mar. 2009.
3. O. Aubert and Y. Prié. Advene: active reading through hypervideo. In Proceedings of the 16th ACM Conference on Hypertext and Hypermedia. HYPERTEXT '05, pages 235--244, New York, NY, USA, 2005. ACM.
4. O. Aubert and Y. Prié. Advene: an open-source framework for integrating and visualising audiovisual metadata. In Proceedings of the 15th International Conference on Multimedia. MULTIMEDIA '07, pages 1005--1008, New York, NY, USA, 2007. ACM.
5. O. Aubert, Y. Prié, and D. Schmitt. Advene as a tailorable hypervideo authoring tool: a case study. In Proceedings of the 2012 ACM Symposium on Document Engineering. DocEng '12, pages 79--82, New York, NY, USA, 2012. ACM.
6. P. Ayres, N. Marcus, C. Chan, and N. Qian. Learning hand manipulative tasks: When instructional animations are superior to equivalent static representations. Computers in Human Behavior, 25(2):348--353, Mar. 2009.
7. P. Ayres and F. Paas. Making instructional animations more effective: a cognitive load approach. Applied Cognitive Psychology, 21(6):695--700, 2007.
8. M. Bäcker. Beck'scher Kommentar Datenschutzrecht., chapter §4 BDSG. C.H. Beck.
9. L. B. Baltussen, J. Blom, and R. Ordelman. Videohype: an editor tool for supervised automatic video hyperlinking. In M. Mancas, N. d' Alessandro, X. Siebert, B. Gosselin, C. Valderrama, and T. Dutoit, editors, Intelligent Technologies for Interactive Entertainment, volume 124 of Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, pages 43--48. Springer International Publishing, 2013.
10. J.-M. Boucheix, R. K. Lowe, D. K. Putri, and J. Groff. Cueing animations: Dynamic signaling aids information extraction and comprehension. Learning and Instruction, 25(0):71--84, 2013.
11. J.-M. Boucheix and E. Schneider. Static and animated presentations in learning dynamic mechanical systems. Learning and Instruction, 19(2):112--127, 2009.
12. D. C. A. Bulterman and L. Hardman. Structured multimedia authoring. ACM Transactions on Multimedia Computing, Communications, and Applications, 1(1):89--109, 2005.
13. T. Chambel, C. Zahn, and M. Finke. Hypervideo design and support for contextualized learning. In IEEE International Conference on Advanced Learning Technologies, 2004. Proceedings., pages 345--349, Aug 2004.
14. U. Dammann. Bundesdatenschutzgesetz. Kommentar, chapter §3 BDSG. Nomos, Baden-Baden, 7th ed. edition, 2011.
15. B. de Koning, H. Tabbers, R. Rikers, and F. Paas. Towards a framework for attention cueing in instructional animations: Guidelines for research and design. Educational Psychology Review, 21(2):113--140, 2009.
16. A. Dillon and J. Jobst. Multimedia Learning with Hypermedia, page 569--588. Cambridge University Press, 2005.
17. P. Gerjets and P. Kirschner. Learning from multimedia and hypermedia. In N. Balacheff, S. Ludvigsen, T. de Jong, A. Lazonder, and S. Barnes, editors, Technology-Enhanced Learning, pages 251--272. Springer Netherlands, 2009.
18. B. S. Hasler, B. Kersten, and J. Sweller. Learner control, cognitive load and instructional animation. Applied Cognitive Psychology, 21(6):713--729, 2007.
19. N. T. Hoeffler and D. Leutner. Instructional animation versus static pictures: A meta-analysis. Learning and Instruction, 17:722--738, 2007.
20. T. N. Höffler and R. N. Schwartz. Effects of pacing and cognitive style across dynamic and non-dynamic representations. Computers & Education, 57(2):1716--1726, 2011.
21. Honkytonk Films. Klynt. Website (accessed April 2, 2014). http://www.klynt.net/.
22. J. Jaeger. Use cases - open hypervideo prototypes & implementations. Website (accessed April 26, 2014), 2012.
23. LinkedTV Consortium. Linkedtv. Website (accessed April 26, 2014), 2013.
24. R. K. Lowe. Animation and learning: selective processing of information in dynamic graphics. Learning and Instruction, 13(2):157--176, 2003. External and Internal Representations in Multimedia Learning.
25. N. Marcus, B. Cleary, A. Wong, and P. Ayres. Should hand actions be observed when learning hand motor skills from instructional animations? Computers in Human Behavior, 29(6):2172--2178, Nov. 2013.
26. R. Mayer. Multimedia Learning. Cambridge University Press, 2010.
27. B. Meixner and H. Kosch. Interactive non-linear video: Definition and xml structure. In Proceedings of the 2012 ACM Symposium on Document Engineering, DocEng '12, pages 49--58, New York, NY, USA, 2012. ACM.
28. B. Meixner, J. Köstler, and H. Kosch. A mobile player for interactive non-linear video. In Proceedings of the 19th ACM International Conference on Multimedia, MM '11, pages 779--780, New York, NY, USA, 2011. ACM.
29. B. Meixner, B. Siegel, G. Hölbling, F. Lehner, and H. Kosch. Siva suite: Authoring system and player for interactive non-linear videos. In Proceedings of the International Conference on Multimedia, MM '10, pages 1563--1566, New York, NY, USA, 2010. ACM.
30. B. Meixner, B. Siegel, P. Schultes, F. Lehner, and H. Kosch. An html5 player for interactive non-linear video with time-based collaborative annotations. In Proceedings of International Conference on Advances in Mobile Computing & Multimedia, MoMM '13, pages 490:490--490:499, New York, NY, USA, 2013. ACM.
31. D. Meyerdierks. Sind ip-adressen personenbezogene daten? Multimedia und Recht, 1:8--13, 2009.
32. W. Müller, U. Spierling, and C. Stockhausen. Production and delivery of interactive narratives based on video snippets. In H. Koenitz, T. Sezen, G. Ferri, M. Haahr, D. Sezen, and G. Catak, editors, Interactive Storytelling, volume 8230 of Lecture Notes in Computer Science, pages 71--82. Springer International Publishing, 2013.
33. D. Ockeloen and P. van Leeuwen. Deliverable 3.6: Interface and presentation engine version 2. Website (accessed December 27, 2013), 2013.
34. K. Pohl. Requirements Engineering. Springer, 2010.
35. L. J. Redondo-Garcia and R. Troncy. Television meets the web: a multimedia hypervideo experience. In L. Aroyo and N. Noy, editors, Proceedings of the Doctoral Consortium co-located with 12th International Semantic Web Conference (ISWC 2013), pages 48--55, 2013. Website (accessed April 26, 2014).
36. A. RoSSnagel and P. Scholz. Datenschutz durch anonymität und pseudonymität rechtsfolgen der verwendung anonymer und pseudonymer daten. Multimedia und Recht, 12:721--731, 2000.
37. K. Scheiter and P. Gerjets. Learner control in hypermedia environments. Educational Psychology Review, 19(3):285--307, 2007.
38. F. Shipman, A. Girgensohn, and L. Wilcox. Combining spatial and navigational structure in the hyper-hitchcock hypervideo editor. In Proceedings of the 14th ACM Conference on Hypertext and Hypermedia. HYPERTEXT '03, pages 124--125, New York, NY, USA, 2003. ACM.
39. F. Shipman, A. Girgensohn, and L. Wilcox. Generation of interactive multi-level video summaries. In Proceedings of the 11th ACM International Conference on Multimedia. MULTIMEDIA '03, pages 392--401, New York, NY, USA, 2003. ACM.
40. F. Shipman, A. Girgensohn, and L. Wilcox. Hypervideo expression: experiences with hyper-hitchcock. In Proceedings of the 16th ACM Conference on Hypertext and Hypermedia. HYPERTEXT '05, pages 217--226, New York, NY, USA, 2005. ACM.
41. F. Shipman, A. Girgensohn, and L. Wilcox. Authoring, viewing, and generating hypervideo: An overview of hyper-hitchcock. ACM Trans. Multimedia Comput. Commun. Appl., 5(2):15:1--15:19, Nov. 2008.
42. S. Simitis. Bundesdatenschutzgesetz. Kommentar, chapter §4a BDSG. Nomos, Baden-Baden, 7th ed. edition, 2011.
43. J. Sweller. Implications of Cognitive Load Theory for Multimedia Learning, chapter 2, pages 19--30. Cambridge University Press, 2005.
44. S. Tjettmers. Social Software in der Hochschullehre: Voraussetzungen und Potentiale für die Gestaltung kooperativer Lernarrangements in der universitären Praxis. Wissenschaftliche Schriften der WWU Münster/6. Verlag-Haus Monsenstein und Vannerdat, 2011.
45. B. Tversky, J. B. Morrison, and M. Betrancourt. Animation: Can it facilitate? International Journal of Human-Computer Studies - Special issue: Interactive graphical communication, 57(4):247--262, Oct. 2002.
46. A. Wong, N. Marcus, P. Ayres, L. Smith, G. A. Cooper, F. Paas, and J. Sweller. Instructional animations can be superior to statics when learning human motor skills. Computers in Human Behavior, 25(2):339--347, Mar. 2009.
47. C. Zahn. Wissenskommunikation mit Hypervideos. Waxmann, 2003.

Index Terms

• Applied computing

  • Document management and text processing

    • Document preparation

      • Multi / mixed media creation

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction paradigms

      • Hypertext / hypermedia