Optimized scalable video transmission based on conditional replenishment of jpeg2000 code-blocks with motion compensation

ABSTRACT

A video stored as a sequence of JPEG2000 images can provide the scalability, flexibility, and accessibility that is lacking in current predictive motion-compensated video coding standards; however, streaming this sequence would consume considerably more bandwidth. This paper presents a new method for optimized streaming of a JPEG2000 video that relies on motion compensation and server-optimized conditional replenishment to reduce temporal redundancy, in collaboration with an intelligent client policy for reconstructing the available content. In particular, we propose transmission of motion vectors and an optimized number of layers, possibly zero, for each code-block of the JPEG2000 representation of each new frame. We also proposethe use of a sliding window to optimize a group of frames such that code-blocks of these frames have more than one chance of being enhanced if that is beneficial to subsequent frames. Rate-distortion optimization in the Lagrangian sense is employed to achieve the lowest possible MSE. It is expected that mobile clients with their limited processing powers would benefit from this work in real-time and interactive applications, such as teleconferencing and surveillance. This paper introduces the concept, formulates optimization criteria, and compares the performance withalternative strategies.

References

1. F.-O. Devaux, J. Meessen, C. Parisot, J.-F. Delaigle, B. Macq, and C. De Vleeschouwer. A flexible video transmission system based on JPEG2000 conditional replenishment with multiple references. Proc. IEEE Int. Conf. Acoust. Speech and Sig. Proc., April 2007.
2. N. Mehrseresht and D. Taubman. An efficient content-adaptive motion compensated 3D-DWT with enhanced spatial and temporal scalability. IEEE Trans. Image Proc., pages 1397--1412, June 2006.
3. A. Naman and D. Taubman. A novel paradigm for optimized scalable video transmission based on JPEG2000 with motion. Proc. IEEE Int. Conf. Image Proc. 2007, Septmeber 2007. in press.
4. J.-R. Ohm. Advances in scalable video coding. Proc. of the IEEE, 93, January 2005.
5. H. Schwarz, D. Marpe, T. Schierl, and T. Wiegand. Combined scalability support for the scalable extension of H.264/AVC. Proc. Int. Conf. on Multimedia and Expo, 2005, July 2005.
6. D. Taubman. Localized distortion estimation from already compressed JPEG2000 images. Proc. IEEE Int. Conf. Image Proc., 2006.
7. D. Taubman and M. Marcellin. JPEG2000: Image Compression Fundamentals, Standards and Practice. Kluwer Academic Publishers, Boston, 2002.
8. P. Zanuttigh, N. Brusco, D. Taubman, and G. Cortelazzo. Server policies for interactive transmission of 3D scenes. IEEE Multimedia Signal Processing Workshop, pages 59--64, October 2006.

Index Terms

• Information systems

  • Information systems applications