skip to main content
10.1145/3347451.3356731acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Investigating Correlations of Automatically Extracted Multimodal Features and Lecture Video Quality

Authors Info & Claims
Published:15 October 2019Publication History

ABSTRACT

Ranking and recommendation of multimedia content such as videos is usually realized with respect to the relevance to a user query. However, for lecture videos and MOOCs (Massive Open Online Courses) it is not only required to retrieve relevant videos, but particularly to find lecture videos of high quality that facilitate learning, for instance, independent of the video's or speaker's popularity. Thus, metadata about a lecture video's quality are crucial features for learning contexts, e.g., lecture video recommendation in search as learning scenarios. In this paper, we investigate whether automatically extracted features are correlated to quality aspects of a video. A set of scholarly videos from a Mass Open Online Course (MOOC) is analyzed regarding audio, linguistic, and visual features. Furthermore, a set of cross-modal features is proposed which are derived by combining transcripts, audio, video, and slide content. A user study is conducted to investigate the correlations between the automatically collected features and human ratings of quality aspects of a lecture video. Finally, the impact of our features on the knowledge gain of the participants is discussed.

References

  1. Maristella Agosti, Norbert Fuhr, Elaine G. Toms, and Pertti Vakkari. 2013. Evaluation Methodologies in Information Retrieval (Dagstuhl Seminar 13441). Dagstuhl Reports , Vol. 3, 10 (2013), 92--126. https://doi.org/10.4230/DagRep.3.10.92Google ScholarGoogle Scholar
  2. Ricardo A. Baeza-Yates and Berthier A. Ribeiro-Neto. 2011. Modern Information Retrieval - the concepts and technology behind search, Second edition. Pearson Education Ltd., Harlow, England. http://www.mir2ed.org/Google ScholarGoogle Scholar
  3. Steven Bird, Ewan Klein, and Edward Loper. 2009. Natural Language Processing with Python. O'Reilly Media Inc., Sebastopol, USA.Google ScholarGoogle Scholar
  4. Paul Boersma and David Weenink. 2018. Praat: doing phonetics by computer [Computer program]. http://www.fon.hum.uva.nl/praat. [Version 6.0.37; retrieved 15-January-2019].Google ScholarGoogle Scholar
  5. Cynthia J. Brame. 2016. Effective Educational Videos: Principles and Guidelines for Maximizing Student Learning from Video Content. CBE-Life Sciences Education , Vol. 15, 4 (2016), es6. https://doi.org/10.1187/cbe.16-03-0125 https://doi.org/10.1016/j.protcy.2013.12.124Google ScholarGoogle ScholarCross RefCross Ref
  6. Pertti Vakkari. 2016. Searching as learning: A systematization based on literature. J. Inf. Sci. , Vol. 42, 1 (2016), 7--18. https://doi.org/10.1177/0165551515615833Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Erlijn van Genuchten, Katharina Scheiter, and Anne Schü ler. 2012. Examining learning from text and pictures for different task types: Does the multimedia effect differ for conceptual, causal, and procedural tasks? Computers in Human Behavior, Vol. 28, 6 (2012), 2209--2218. https://doi.org/10.1016/j.chb.2012.06.028Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Bart L. Weathington, Christopher J. L. Cunningham, and David J. Pittenger. 2012. Understanding Business Research. John Wiley & Sons, Inc., Hoboken, New Jersey. https://doi.org/10.1002/9781118342978Google ScholarGoogle Scholar
  9. Ran Yu, Ujwal Gadiraju, Peter Holtz, Markus Rokicki, Philipp Kemkes, and Stefan Dietze. 2018. Predicting User Knowledge Gain in Informational Search Sessions. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, USA, July 08--12, 2018 . 75--84. https://doi.org/10.1145/3209978.3210064Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Eiji Yumoto, W J Gould, and T Baer. 1982. Harmonics-to-noise ratio as an index of the degree of hoarseness. The Journal of the Acoustical Society of America , Vol. 71 (July 1982), 1544.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Investigating Correlations of Automatically Extracted Multimodal Features and Lecture Video Quality

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          SALMM '19: Proceedings of the 1st International Workshop on Search as Learning with Multimedia Information
          October 2019
          25 pages
          ISBN:9781450369190
          DOI:10.1145/3347451
          • General Chairs:
          • Ralph Ewerth,
          • Stefan Dietze,
          • Anett Hoppe,
          • Ran Yu

          Copyright © 2019 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 15 October 2019

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Upcoming Conference

          MM '24
          MM '24: The 32nd ACM International Conference on Multimedia
          October 28 - November 1, 2024
          Melbourne , VIC , Australia

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader