Exploring interest correlation for peer-to-peer socialized video sharing

Abstract

The last five years have witnessed an explosion of networked video sharing, represented by YouTube, as a new killer Internet application. Their sustainable development however is severely hindered by the intrinsic limit of their client/server architecture. A shift to the peer-to-peer paradigm has been widely suggested with success already shown in live video streaming and movie-on-demand. Unfortunately, our latest measurement demonstrates that short video clips exhibit drastically different statistics, which would simply render these existing solutions suboptimal, if not entirely inapplicable.

Our long-term measurement over five million YouTube videos, on the other hand, reveals interesting social networks with strong correlation among the videos, thus opening new opportunities to explore. In this article, we present NetTube, a novel peer-to-peer assisted delivering framework that explores the user interest correlation for short video sharing. We address a series of key design issues to realize the system, including a bi-layer overlay, an efficient indexing scheme, a delay-aware scheduling mechanism, and a prefetching strategy leveraging interest correlation. We evaluate NetTube through both simulations and prototype experiments, which show that it greatly reduces the server workload, improves the playback quality and scales well.

References

1. Aggarwal, V., Caldebank, R., Gopalakrishnan, V., Jana, R., Ramakrishnan, K., and Yu, F. 2009. The effectiveness of intelligent scheduling for multicast video-on-demand. In Proceedings of the 17th ACM International Conference on Multimedia (MM). ACM, New York, NY, 421--430.
2. Albert, R., Jeong, H., and Barabási, A.-L. 1999. The diameter of the World Wide Web. Nature 401, 130--131.
3. Alexa. 2010. Youtube.com site info. http://www.alexa.com/siteinfo/youtube.com.
4. Benevenuto, F., Rodrigues, T., Cha, M., and Almeida, V. 2009. Characterizing user behavior in online social networks. In Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 49--62.
5. Blog, O. Y. 2009. Zoinks! 20 hours of video uploaded every minute! http://youtube-global.blogspot.com/2009/05/zoinks-20-hours-of-video-uploaded-every_20.html.
6. Bloom, B. 1970. Space/time trade-offs in hash coding with allowable errors. Comm. ACM 13, 7, 422--426.
7. Carter, L. 2008. Web could collapse as video demand soars. http://www.telegraph.co.uk/news/uknews/1584230/Web-could-collapse-as-video -demand-soars.html.
8. Cha, M., Kwak, H., Rodriguez, P., Ahn, Y.-Y., and Moon, S. 2007. I tube, you tube, everybody tubes: Analyzing the world's largest user generated content video system. In Proceedings of the 7th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 1--14.
9. Cha, M., Rodriguez, P., Crowcroft, J., Moon, S., and Amatriain, X. 2008. Watching television over an IP network. In Proceedings of the 8th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 71--84.
10. Cheng, X., Dale, C., and Liu, J. 2008. Statistics and social network of YouTube videos. In Proceedings of the 16th International Workshop on Quality of Service (IWQoS). IEEE, Los Alamitos, CA, 229--238.
11. Cheng, X. and Liu, J. 2009. NetTube: Exploring social networks for peer-to-peer short video sharing. In Proceedings of the 28th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 1152--1160.
12. Cheng, X., Liu, J., and Dale, C. 2010. Understanding the characteristics of internet short video sharing: A YouTube-based measurement study. IEEE Trans. Multimedia.
13. Corbett, C. 2006. Peering of video. http://www.nanog.org/mtg-0606/pdf/bill.norton.3.pdf.
14. Gill, P., Arlitt, M., Li, Z., and Mahanti, A. 2007. YouTube traffic characterization: A view from the edge. In Proceedings of the 7th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 15--28.
15. Gopalakrishnan, V., Bhattacharjeey, B., Ramakrishnan, K., Jana, R., and Srivastava, D. 2009. CPM: Adaptive video-on-demand with cooperative peer assists and multicast. In Proceedings of the 28th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 91--99.
16. Huang, C., Li, J., and Ross, K. 2007. Can internet video-on-demand be profitable? In Proceedings of ACM SIGCOMM. ACM, New York, NY, 133--144.
17. Huang, Y., Fu, T. Z., Chiu, D.-M., Lui, J. C., and Huang, C. 2008. Challenges, design and analysis of a large-scale P2P-VoD system. In Proceedings of the ACM SIGCOMM. ACM, New York, NY, 375--388.
18. La Monica, P. R. 2006. Google to buy YouTube for $1.65 billion. http://money.cnn.com/2006/10/09/technology/googleyoutube_deal.
19. Lai, K. and Wang, D. 2010. The implication of external links on video sharing sites: Measurement and analysis. In Proceedings of the 20th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV). ACM, New York, NY.
20. Liang, C., Guo, Y., and Liu, Y. 2009. Investigating the scheduling sensitivity of P2P video streaming: An experimental study. IEEE Trans. Multimedia 11, 3, 348--360.
21. Liu, J., Rao, S. G., Li, B., and Zhang, H. 2008. Opportunities and challenges of peer-to-peer Internet Video Broadcast. Proc. IEEE 96, 1, 11--24.
22. Liu, Z., Wu, C., Li, B., and Zhao, S. 2009. Distilling superior peers in large-scale P2P streaming systems. In Proceedings of the 28th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 82--90.
23. Magharei, N. and Rejaie, R. 2009a. Overlay monitoring and repair in swarm-based peer-to-peer streaming. In Proceedings of the 19th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV). ACM, New York, NY, 25--30.
24. Magharei, N. and Rejaie, R. 2009b. PRIME: Peer-to-peer receiver-driven mesh-based streaming. IEEE/ACM Trans. Netw. 17, 4, 1052--1065.
25. Mislove, A., Marcon, M., Gummadi, K., Dreschel, P., and Bhattacharjee, B. 2007. Measurement and analysis of online social networks. In Proceedings of the 7th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 29--42.
26. O'Reilly, T. 2005. What Is Web 2.0: Design patterns and business models for the next generation of software. http://www.oreilly.com/pub/a/oreilly/tim/news/2005/09/30/what-is-web-20.html.
27. Qiu, X., Wu, C., Lin, X., and Lau, F. C. 2009. InstantLeap: Fast neighbor discovery in P2P VoD streaming. In Proceedings of the 19th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV). ACM, New York, NY, 19--24.
28. Rao, L. 2010. comScore: YouTube reaches all-time high of 14.6 billion videos viewed in May. http://techcrunch.com/2010/06/24/comscore-youtube-reaches-all-time-high-of-14-6-billion-videos-viewed-in-may.
29. Saxena, M., Sharan, U., and Fahmy, S. 2008. Analyzing video services in Web 2.0: A global perspective. In Proceedings of the 18th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV). ACM, New York, NY, 39--44.
30. Schneider, F., Feldmann, A., Krishnamurthy, B., and Willinger, W. 2009. Understanding Online Social Network Usage from a Network Perspective. In Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 35--48.
31. Song, H. H., Cho, T. W., Dave, V., Zhang, Y., and Qiu, L. 2009. Scalable Proximity Estimation and Link Prediction in Online Social Networks. In Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 322--335.
32. Venkataraman, V., Yoshida, K., and Francis, P. 2006. Chunkyspread: Heterogeneous unstructured tree-based peer-to-peer multicast. In Proceedings of the 14th IEEE International Conference on Network Protocols (ICNP). IEEE, Los Alamitos, CA, 2--11.
33. Wang, F., Liu, J., and Xiong, Y. 2008. Stable peers: Existence, importance, and application in peer-to-peer live video streaming. In Proceedings of the 27th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 1364--1372.
34. Watts, D. 1999. Small Worlds: the Dynamics of Networks Between Order and Randomness. Princeton University Press, Princeton, NJ.
35. Wu, C., Li, B., and Zhao, S. 2008. Multi-channel live P2P streaming: Refocusing on servers. In Proceedings of the 27th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 1355--1363.
36. Wu, D., Liang, C., Liu, Y., and Ross, K. 2009. View-upload decoupling: A redesign of multi-channel P2P video systems. In Proceedings of the 28th IEEE Conference on Computer Communications (INFOCOM). IEEE, Los Alamitos, CA, 2726--2730.
37. Yen, Y.-W. 2008. YouTube looks for the money clip. http://techland.blogs.fortune.cnn.com/2008/03/25/youtube-looks-for-the-money-clip.
38. Yin, H., Liu, X., Qiu, F., Xia, N., Lin, C., Zhang, H., Sekar, V., and Min, G. 2009. Inside the bird's Nest: Measurements of large-scale live VoD from the 2008 Olympics. In Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement (IMC). ACM, New York, NY, 442--455.
39. Zhang, X., Liu, J., Li, B., and Yum, T.-S. P. 2005. CoolStreaming/DONet: A data-driven overlay network for peer-to-peer live media streaming. In Proceedings of the 24th IEEE Conference on Computer Communications (INFOCOM). Vol. 3. IEEE, Los Alamitos, CA, NJ, 2102--2111.

Index Terms

• Software and its engineering

  • Software organization and properties

    • Software system structures

      • Distributed systems organizing principles

        • Organizing principles for web applications