Andreas Girgensohn
Frank Shipman
Lynn Wilcox
ABSTRACT
Although people are capturing more video with their mobile phones, digital cameras, and other devices, they rarely watch all that video. More commonly, users extract a still image from the video to print or a short clip to share with others. We created a novel interface for browsing through a video keyframe hierarchy to find frames or clips. The interface is shown to be more efficient than scrolling linearly through all keyframes. We developed algorithms for selecting quality keyframes and for clustering keyframes hierarchically. At each level of the hierarchy, a single representative keyframe from each cluster is shown. Users can drill down into the most promising cluster and view representative keyframes for the sub-clusters. Our clustering algorithms optimize for short navigation paths to the desired keyframe. A single keyframe is located using a non-temporal clustering algorithm. A video clip is located using one of two temporal clustering algorithms. We evaluated the clustering algorithms using a simulated search task. User feedback provided us with valuable suggestions for improvements to our system.
- C.-H. An, K. Berry, and A. Cosby. Fractal image compression by improved balanced tree clustering Proc. of SPIE, Vol. 3164, Applications of Digital Image Processing XX, 555--564, 1997.Google Scholar
- G. Ciocca and R. Schettini. Hierarchical Browsing of Video Key Frames. Lecture Notes in Computer Science, Vol. 4425, Advances in Information Retrieval, 691--694, 2007. Google ScholarDigital Library
- M. Cooper and J. Foote. Scene Boundary Detection Via Video Self-Similarity Analysis. Proc. of Int. Conf. on Image Processing, 378--381, 2001.Google ScholarCross Ref
- S. Geva. K-tree: a height balanced tree structured vector quantizer. Proc. of 2000 IEEE Signal Processing Society Workshop. Vol. 1, 271--280, 2000.Google ScholarCross Ref
- A. Girgensohn, S. Bly, F. Shipman, J. Boreczky, and L. Wilcox. Home Video Editing Made Easy --- Balancing Automation and User Control. Proc. of INTERACT '01, IOS Press, 464--471, 2001.Google Scholar
- M. Guillemot and P. Wellner. A Hierarchical Keyframe User Interface for Browsing Video over the Internet. Proc. of INTERACT '03, 769--776, 2003.Google Scholar
- W. Hürst, G. Götz, and P. Jarvers. Advanced User Interfaces for Dynamic Video Browsing, Proc. of ACM Multimedia, 742--743, 2004. Google ScholarDigital Library
- J. Jiang and X.-P. Zhang. A New Hierarchical Key Frame Tree-Based Video Representation Method Using Independent Component Analysis. Advanced Intelligent Computing Theories and Applications. With Aspects of Artificial Intelligence. Lecture Notes in Computer Science, Vol. 6216/2010, 132--139, 2010. Google ScholarDigital Library
- J. Luo, C. Papin, and K. Costello. Towards Extracting Semantically Meaningful Key Frames From Personal Video Clips: From Humans to Computers. IEEE Transactions on Circuits and Systems for Video Technology, 19(2), 289--301, 2009. Google ScholarDigital Library
- C.-W. Ngo, T.-C. Pong, and H.-J. Zhang. On Clustering and Retrieval of Video Shots. Proc. of ACM Multimedia, 51--60, 2001. Google ScholarDigital Library
- J. H. Oh and K. A. Hua. Efficient and Cost-effective Techniques for Browsing and Indexing Large Video Databases. Proc. of ACM Conf. on Management of Data, 415--426, 2000. Google ScholarDigital Library
- Y. Rui, T. Huang, and S. Mehratra. Constructing Table-of-Contents for Videos. ACM Multimedia Systems, 7(5):359--368, 1999. Google ScholarDigital Library
- K. Schoeffmann, M. Taschwer, and L. Boeszoermenyi. The Video Explorer --- A Tool for Navigation and Searching within a Single Video based on Fast Content Analysis. Proc. of ACM Conf. on Multimedia Systems, 247--258, 2010. Google ScholarDigital Library
- F. Shipman, A. Girgensohn, and L. Wilcox. Hypervideo Expression: Experiences with Hyper-Hitchcock. Proc. of ACM Conf. on Hypertext and Hypermedia, 217--226, 2005. Google ScholarDigital Library
- K. Wittenburg, C. Forlines, T. Lanning, A. Esenther, S. Harada, and T. Miyachi. Rapid Serial Visual Presentation Techniques for Consumer Digital Video Devices. Proc. of ACM UIST, 115--124, 2003. Google ScholarDigital Library
- J. Xiao, X. Zhang, P. Cheatle, Y. Gao, C. B. Atkins. Mixed-Initiative Photo Collage Authoring. Proc. of ACM Multimedia, 509--518, 2008. Google ScholarDigital Library
- T. Zhang, R. Ramakrishnan, and M. Livny. BIRCH: An Efficient Data Clustering Method for Very Large Databases. Proc. of ACM Conf. on Management of Data, 103--114. 1996. Google ScholarDigital Library
- D. Zhong, H. Zhang and S.-F. Chang. Clustering Methods for Video Browsing and Annotation. Proc of SPIE Conf. on Storage and Retrieval for Image and Video Databases, 1997.Google Scholar
Index Terms
- Adaptive clustering and interactive visualizations to support the selection of video clips
Recommendations
Hierarchical Adaptive Clustering
This paper studies an adaptive clustering problem. We focus on re-clustering an object set, previously clustered, when the feature set characterizing the objects increases. We propose an adaptive clustering method based on a hierarchical agglomerative ...
An adaptive algorithm for clustering cumulative probability distribution functions using the Kolmogorov-Smirnov two-sample test
An adaptive clustering algorithm has been proposed.The measure distance proposed is Kolmogorov-Smirnov statistics.A practical application of the algorithm proves its power.The proposed algorithm allows better clustering solar spectra data than classical ...
Ensemble clustering with voting active clusters
Clustering is an integral part of pattern recognition problems and is connected to both the data reduction and the data understanding steps. Combining multiple clusterings into an ensemble clustering is critical in many real world applications, ...
Comments