ABSTRACT
Ranking and recommendation of multimedia content such as videos is usually realized with respect to the relevance to a user query. However, for lecture videos and MOOCs (Massive Open Online Courses) it is not only required to retrieve relevant videos, but particularly to find lecture videos of high quality that facilitate learning, for instance, independent of the video's or speaker's popularity. Thus, metadata about a lecture video's quality are crucial features for learning contexts, e.g., lecture video recommendation in search as learning scenarios. In this paper, we investigate whether automatically extracted features are correlated to quality aspects of a video. A set of scholarly videos from a Mass Open Online Course (MOOC) is analyzed regarding audio, linguistic, and visual features. Furthermore, a set of cross-modal features is proposed which are derived by combining transcripts, audio, video, and slide content. A user study is conducted to investigate the correlations between the automatically collected features and human ratings of quality aspects of a lecture video. Finally, the impact of our features on the knowledge gain of the participants is discussed.
- Maristella Agosti, Norbert Fuhr, Elaine G. Toms, and Pertti Vakkari. 2013. Evaluation Methodologies in Information Retrieval (Dagstuhl Seminar 13441). Dagstuhl Reports , Vol. 3, 10 (2013), 92--126. https://doi.org/10.4230/DagRep.3.10.92Google Scholar
- Ricardo A. Baeza-Yates and Berthier A. Ribeiro-Neto. 2011. Modern Information Retrieval - the concepts and technology behind search, Second edition. Pearson Education Ltd., Harlow, England. http://www.mir2ed.org/Google Scholar
- Steven Bird, Ewan Klein, and Edward Loper. 2009. Natural Language Processing with Python. O'Reilly Media Inc., Sebastopol, USA.Google Scholar
- Paul Boersma and David Weenink. 2018. Praat: doing phonetics by computer [Computer program]. http://www.fon.hum.uva.nl/praat. [Version 6.0.37; retrieved 15-January-2019].Google Scholar
- Cynthia J. Brame. 2016. Effective Educational Videos: Principles and Guidelines for Maximizing Student Learning from Video Content. CBE-Life Sciences Education , Vol. 15, 4 (2016), es6. https://doi.org/10.1187/cbe.16-03-0125 https://doi.org/10.1016/j.protcy.2013.12.124Google ScholarCross Ref
- Pertti Vakkari. 2016. Searching as learning: A systematization based on literature. J. Inf. Sci. , Vol. 42, 1 (2016), 7--18. https://doi.org/10.1177/0165551515615833Google ScholarDigital Library
- Erlijn van Genuchten, Katharina Scheiter, and Anne Schü ler. 2012. Examining learning from text and pictures for different task types: Does the multimedia effect differ for conceptual, causal, and procedural tasks? Computers in Human Behavior, Vol. 28, 6 (2012), 2209--2218. https://doi.org/10.1016/j.chb.2012.06.028Google ScholarDigital Library
- Bart L. Weathington, Christopher J. L. Cunningham, and David J. Pittenger. 2012. Understanding Business Research. John Wiley & Sons, Inc., Hoboken, New Jersey. https://doi.org/10.1002/9781118342978Google Scholar
- Ran Yu, Ujwal Gadiraju, Peter Holtz, Markus Rokicki, Philipp Kemkes, and Stefan Dietze. 2018. Predicting User Knowledge Gain in Informational Search Sessions. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, USA, July 08--12, 2018 . 75--84. https://doi.org/10.1145/3209978.3210064Google ScholarDigital Library
- Eiji Yumoto, W J Gould, and T Baer. 1982. Harmonics-to-noise ratio as an index of the degree of hoarseness. The Journal of the Acoustical Society of America , Vol. 71 (July 1982), 1544.Google ScholarCross Ref
Index Terms
- Investigating Correlations of Automatically Extracted Multimodal Features and Lecture Video Quality
Recommendations
Effects of In-Video Quizzes on MOOC Lecture Viewing
L@S '16: Proceedings of the Third (2016) ACM Conference on Learning @ ScaleOnline courses on sites such as Coursera use quizzes embedded inside lecture videos (in-video quizzes) to help learners test their understanding of the video. This paper analyzes how users interact with in-video quizzes, and how in-video quizzes ...
Video assessment patterns: designing video player for integrated assessment
EuroPlop '16: Proceedings of the 21st European Conference on Pattern Languages of ProgramsVideo-based learning plays an important role in many blended and distance learning courses. The same is true for assessment as a key element in individual and collaborative learning scenarios. In this paper we discuss nine patterns on how to integrate ...
Investigating Engagement with In-Video Quiz Questions in a Programming Course
In-video quizzes are common in many distance learning platforms, including those from Coursera and EdX. However, the effectiveness of in-video quizzes has not previously been assessed. In this paper, we describe the construction and instrumentation of an ...
Comments