The CPR model for summarizing video

ABSTRACT

Most past work on video summarization has been based on selecting key frames from videos. We propose a model of video summarization based on three important parameters: Priority (of frames), Continuity (of the summary), and non-Repetition (of the summary). In short, a summary must include high priority frames, must be continuous and non-repetitive. An optimal summary is one that maximizes an objective function based on these three parameters. We develop formal definitions of all these concepts and provide algorithms to find optimal summaries. We briefly report on the performance of these algorithms.

References

1. S. Adali, K.S. Candan, S.-S. Chen, K. Erol, and V.S.Subrahmanian. Advanced Video Information Systems. ACM Multimedia Systems Journal, Vol. 4, 1996, pp. 172--186.
2. T.H. Cormen, C.E. Leiserson, R.L. Rivest, and C. Stein. "Introduction to Algorithms, 2nd Edition" MIT Press, 2001.
3. D. DeMenthon, D.S. Doermann, and V. Kobla. Video Summarization by Curve Simplification. Proc. ACM Multimedia, Bristol, England, 1998, pp. 211--218.
4. L. He, E. Sanocki, A. Gupta, and J. Grudin. Auto-Summarization of Audio-Video Presentations. ACM Proc. on Multimedia, 1999, pp. 489--498.
5. S. Ju, M. Black, S. Minneman, and D. Kimber. Summarization of Videotaped Presentations: Automatic Analysis of Motion and Gesture. IEEE Trans. on Circuits and Systems for Video Technology, Vol. 8(5), 1998, pp. 686--696.
6. Y.P. Ma, L. Lu, H.J. Zhang, and M. Li. A User Attention Model for Video Summarization. Proc. ACM Multimedia, 2002.
7. H.Martin and R.Lozano. Dynamic Generation of Video Abstracts Using an Object Oriented Video DBMS. Networking and Information Systems Journal, Vol. 3(1), 2000, pp. 53--75.
8. H.R. Naphide and T.S. Huang. A Probabilistic Framework for Semantic Video Indexing, Filtering, and Retrieval. IEEE Transactions on Multimedia, Vol. 3(1), 2001, pp. 141--151.
9. E. Oomoto and K. Tanaka. OVID: Design and Implementation of a Video-Object Database System. IEEE TKDE (Multimedia Information Systems, Vol. 5(4), 1993, pp. 629--643.
10. C. Stauffer and E. Frimson. Learning Patterns of Activity Using Real-Time Tracking. IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 22(8), 2000, pp 747--757.
11. V.S. Subrahmanian. "Principles of Multimedia Database Systems" Morgan Kaufmann, 1998.
12. D. Zhong and S.F. Chang. Video Object Model and Segmentation for Content-Based Video Indexing. IEEE Intern. Conf. on Circuits and Systems, June, 1997, Hong Kong.
13. W. Zhou, A. Vellaikal, and C.C. Jay Kuo. Rule-Based Video Classification System for Basketball Video Indexing. Proc. ACM Multimedia Workshop, 2000, pp. 213--216.

Index Terms

• Information systems

  • Information systems applications

    • Multimedia information systems

      • Multimedia databases