Keyframe-less integration of semantic information in a video player interface

ABSTRACT

In this paper, we describe a novel approach of integrating semantic information into video player interfaces. As opposed to the common approach of using static keyframes representing video segments we provide an interactive preview slider combined with navigation blocksrepresenting semantically segmented video strips. With regard to the use of computer devices for watching feature movies and series we employed segments representing scene and speech information within a prototype which has been tested in an experimental user study.

References

1. J. Brooke. SUS -- A quick and dirty usability scale, chapter 21, pages 189--194. Taylor & Francis, 1996.
2. Z. Cerneková, I. Pitas, and C. Nikou. Information theory-based shot cut/fade detection and video summarization. IEEE Trans. Circuits Syst. Video Techn., 16(1):82--91, 2006.
3. Y. Choi, S. J. Kim, and S. Lee. Hierarchical shot clustering for video summarization. In ICCS '02: Proceedings of the International Conference on Computational Science-Part III, pages 1100--1107, London, UK, 2002. Springer-Verlag.
4. S. M. Drucker, A. Glatzer, S. D. Mar, and C. Wong. Smartskip: consumer level browsing and skipping of digital video content. In CHI '02: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 219--226, New York, NY, USA, 2002. ACM Press.
5. E. Elliott and G. Davenport. Video streamer. In CHI '94: Conference companion on Human factors in computing systems, pages 65--68, New York, NY, USA, 1994. ACM Press.
6. A. Girgensohn, J. Adcock, M. D. Cooper, and L. Wilcox. A synergistic approach to efficient interactive video retrieval. In Human-Computer Interaction - INTERACT 2005, IFIP TC13 International Conference, Rome, Italy, September 12-16, 2005, Proceedings, volume 3585 of Lecture Notes in Computer Science, pages 781--794. Springer, 2005.
7. A. Haubold and J. R. Kender. Vast mm: multimedia browser for presentation video. In CIVR '07: Proceedings of the 6th ACM international conference on Image and video retrieval, pages 41--48, New York, NY, USA, 2007. ACM Press.
8. W. Hürst, G. Götz, and P. Jarvers. Advanced user interfaces for dynamic video browsing. In MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on Multimedia, pages 742--743, New York, NY, USA, 2004. ACM Press.
9. W. Hürst and K. Meier. Interfaces for timeline-based mobile video browsing. In MM '08: Proceeding of the 16th ACM international conference on Multimedia, pages 469--478, New York, NY, USA, 2008. ACM.
10. H. Lee, P. Ferguson, C. Gurrin, A. F. Smeaton, N. E. O'Connor, and H. Park. Balancing the power of multimedia information retrieval and usability in designing interactive tv. In UXTV '08: Proceeding of the 1st international conference on Designing interactive user experiences for TV and video, pages 105--114, New York, NY, USA, 2008. ACM.
11. H. Lee and A. F. Smeaton. Designing the user-interface for the físchlár digital video library. Journal of Digital Information, Special Issue on Interactivity in Digital Libraries, Vol.2 No.4, 2(4), 2002.
12. F. C. Li, A. Gupta, E. Sanocki, L. wei He, and Y. Rui. Browsing digital video. In CHI '00: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 169--176, New York, NY, USA, 2000. ACM Press.
13. K. Manske. Video browsing using 3d video content trees. In NPIV '98: Proceedings of the 1998 workshop on New paradigms in information visualization and manipulation, pages 20--24, New York, NY, USA, 1998. ACM Press.
14. M. Mills, J. Cohen, and Y. Y. Wong. A magnifier tool for video data. In CHI '92: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 93--98, New York, NY, USA, 1992. ACM Press.
15. G. Ramos and R. Balakrishnan. Fluid interaction techniques for the control and annotation of digital video. In UIST '03: Proceedings of the 16th annual ACM symposium on User interface software and technology, pages 105--114, New York, NY, USA, 2003. ACM Press.
16. Y. Rui, T. S. Huang, and S. Mehrotra. Constructing table-of-content for videos. Multimedia Syst., 7(5):359--368, 1999.
17. T. Tse, G. Marchionini, W. Ding, L. Slaughter, and A. Komlodi. Dynamic key frame presentation techniques for augmenting video browsing. In AVI '98: Proceedings of the working conference on Advanced visual interfaces, pages 185--194, New York, NY, USA, 1998. ACM Press.
18. M. Yang and G. Marchionini. Deciphering visual gist and its implications for video retrieval and interface design. In CHI '05: CHI '05 extended abstracts on Human factors in computing systems, pages 1877--1880, New York, NY, USA, 2005. ACM.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction paradigms

      • Graphical user interfaces