Zhaowei Tan
Yuanjie Li
Skip Abstract Section
Abstract
Mobile virtual reality (VR) headsets (e.g., Google Cardboard and Samsung Gear VR) seek to offer "anytime, anywhere" panorama, immerse 3D experiences for users. In this work, we study the viability of supporting mobile VR over operational 4G LTE networks, where the device provides pose information to the edge servers to offload graphical processing. We find that, contrary to common perceptions, wireless bandwidth is not the latency bottleneck for medium-quality VR. Instead, the signaling operations, which facilitate wireless data delivery, constitute a bulk portion of the latency. We report findings that challenge five common beliefs on VR network latency in LTE under both static and mobile scenarios, and quantify their impact. We design LTE-VR, a client-side solution to medium-quality VR over LTE. LTE-VR leverages cross-layer design and rich side channel information to reduce various latency sources in the signaling operations. Our prototype evaluation has confirmed its viability in 4G LTE. We discuss its applicability to the upcoming 5G.
- 3GPP. 2006. TS25.331: Radio Resource Control (RRC). (2006). http://www.3gpp.org/ftp/Specs/html-info/25331.htmGoogle Scholar
- 3GPP. 2012. TS36.322: Evolved Universal Terrestrial Radio Access (E-UTRA); Radio Link Control (RLC) protocol specification. (Sep.. 2012). http://www.3gpp.org/DynaReport/36322.htmGoogle Scholar
- 3GPP. 2014. TS36.321: Evolved Universal Terrestrial Radio Access (E-UTRA); Medium Access Control (MAC) protocol specification. (Mar.. 2014). http://www.3gpp.org/DynaReport/36321.htmGoogle Scholar
- 3GPP. 2015 a. TS23.401: General Packet Radio Service enhancements for Evolved Universal Terrestrial Radio Access Network (E-UTRAN) access. (Dec.. 2015). http://www.3gpp.org/ftp/Specs/html-info/23401.htmGoogle Scholar
- 3GPP. 2015 b. TS36.133: Requirements for support of radio resource management. (Mar.. 2015). http://www.3gpp.org/ftp/Specs/html-info/36133.htmGoogle Scholar
- 3GPP. 2015 c. TS36.331: Radio Resource Control (RRC). (Mar.. 2015). http://www.3gpp.org/ftp/Specs/html-info/36331.htmGoogle Scholar
- 3GPP. 2017 a. 3GPP 5G New Radio Working Group: Radio Interface architecture and protocols. (2017). http://www.3gpp.org/Specifications-groups/ran-plenary/46-ran2-radio-layer-2-and-radio-layerGoogle Scholar
- 3GPP. 2017 b. TS36.211: Evolved Universal Terrestrial Radio Access (E-UTRA); Physical channels and modulation. (2017).Google Scholar
- 3GPP. 2017 c. TS36.213: Evolved Universal Terrestrial Radio Access (E-UTRA); Physical layer procedures. (2017).Google Scholar
- 3GPP. 2017 d. TS38.322: Technical Specification Group Radio Access Network; NR; Packet Data Convergence Protocol (PDCP) specification. (Jun.. 2017).Google Scholar
- Omid Abari, Dinesh Bharadia, Austin Duffield, and Dina Katabi. 2016. Cutting the Cord in Virtual Reality. In ACM HotNets. 162--168. Google ScholarDigital Library
- Michael Abrash. 2014. What VR Could, Should, and almost certainly Will be within two years. http://media.steampowered.com/apps/abrashblog/Abrash%20Dev%20Days%202014.pdf. (2014).Google Scholar
- Sharad Agarwal and Jacob R. Lorch. 2009. Matchmaking for Online Games and Other Latency-sensitive P2P Systems ACM SIGCOMM. 315--326. Google ScholarDigital Library
- Robert S Allison, Laurence R Harris, Michael Jenkin, Urszula Jasiobedzka, and James E Zacher. 2001. Tolerance of temporal delay in virtual environments IEEE Virtual Reality. Yokohama, Japan, 247--254. Google ScholarDigital Library
- ArsTechnica. 2016. Nvidia GTX 1080 review: The new performance king. https://arstechnica.com/gadgets/2016/05/nvidia-gtx-1080-review/4/. (May. 2016).Google Scholar
- Lukas M Batteau, Alan Liu, JB Antoine Maintz, Yogendra Bhasin, and Mark W Bowyer. 2004. A study on the perception of haptics in surgical simulation. Springer Medical Simulation. Berlin, Heidelberg, 185--192.Google Scholar
- Kevin Boos, David Chu, and Eduardo Cuervo. 2016. FlashBack: Immersive Virtual Reality on Mobile Devices via Rendering Memoization ACM MobiSys. 291--304. Google ScholarDigital Library
- Hypergrid Business. 2016. Report: 98% of VR headsets sold in 2016 are for mobile phones. http://www.hypergridbusiness.com/2016/11/report-98-of-vr-headsets-sold-this-year-are-for-mobile-phones/. (Nov. 2016).Google Scholar
- Tech Crunch. 2017. Google has shipped 10M Cardboard VR viewers, 160M Cardboard app downloads. https://techcrunch.com/2017/02/28/google-has-shipped-10m-cardboard-vr-viewers-160m-cardboard-app-downloads/. (Feb. 2017).Google Scholar
- Android developers. 2017. Sensors Overview. https://developer.android.com/guide/topics/sensors/sensors_overview.html. (2017).Google Scholar
- Savio Dimatteo, Pan Hui, Bo Han, and Victor O. K. Li. 2011. Cellular Traffic Offloading through WiFi Networks. IEEE MASS. Valencia, Spain, 192--201. Google ScholarDigital Library
- Charles Dunn and Brian Knott. 2017. Resolution-defined projections for virtual reality video compression IEEE Virtual Reality. Los Angeles, CA, USA, 337--338.Google Scholar
- Facebook. 2017. Facebook Spaces: A New Way To Connect With Friends In VR. https://newsroom.fb.com/news/2017/04/facebook-spaces/. (2017).Google Scholar
- GFXBench. 2017 a. 3D Graphics Performance of Google Pixel C. https://gfxbench.com/device.jsp?D=Google+Pixel+C. (July. 2017).Google Scholar
- GFXBench. 2017 b. 3D Graphics Performance of Samsung Galaxy S7 edge (Mali-T880, SM-G935x). (March. 2017).Google Scholar
- Google. 2017 a. Full OTA Images for Nexus and Pixel Devices. https://developers.google.com/android/ota. (2017).Google Scholar
- Google. 2017 b. Google Cardboard. https://vr.google.com/cardboard/. (2017).Google Scholar
- Google. 2017 c. Google Daydream. https://vr.google.com/daydream/. (2017).Google Scholar
- NVIDIA GRID. 2017. Virtualization Partners, NVIDIA GRID. http://www.nvidia.com/object/grid-partners.html. (2017).Google Scholar
- GTMoogle. 2016. StreamTheater: Hacking together MoonLight and Oculus Cinema for GearVR. https://github.com/GTMoogle/StreamTheater. (2016).Google Scholar
- Peter He. 2016. Virtual Reality for Budget Smartphones. Young Scientists Journal Vol. 18 (Jan. 2016), 50--57.Google Scholar
- The White House. 2016. Administration Announces an Advanced Wireless Research Initiative, Building on President's Legacy of Forward-Leaning Broadband Policy. https://www.whitehouse.gov/the-press-office/2016/07/15/fact-sheet-administration-announces-advanced-wireless-research. (Jul.. 2016).Google Scholar
- Huawei. 2013. 5G: A Technology Vision. http://www.huawei.com/5gwhitepaper/. (2013).Google Scholar
- Google Inc.. 2017. Android.Telephony. (2017). http://developer.android.com/reference/android/telephony/package-summary.htmlGoogle Scholar
- GSMA Intelligence. 2014. Understanding 5G: Perspectives on future technological advancements in mobile. https://www.gsmaintelligence.com/research/?file=141208--5g.pdf&download. (Dec.. 2014).Google Scholar
- Teemu K"am"ar"ainen, Matti Siekkinen, Antti Yl"a-J"a"aski, Wenxiao Zhang, and Pan Hui. 2017. Dissecting the End-to-end Latency of Interactive Mobile Video Applications ACM HotMobile. New York, NY, USA, 61--66. Google ScholarDigital Library
- Joongheon Kim, Jae-Jin Lee, and Woojoo Lee. 2017. Strategic Control of 60 GHz Millimeter-Wave High-Speed Wireless Links for Distributed Virtual Reality Platforms. Mobile Information Systems (2017), 10.Google Scholar
- Yoora Kim, Kyunghan Lee, and Ness B. Shroff. 2014. An Analytical Framework to Characterize the Efficiency and Delay in a Mobile Data Offloading System. In ACM MobiHoc. New York, NY, USA, 267--276. Google ScholarDigital Library
- Zeqi Lai, Y Charlie Hu, Yong Cui, Linhui Sun, and Ningwei Dai. 2017. Furion: Engineering High-Quality Immersive Virtual Reality on Today's Mobile Devices ACM Mobicom. Snowbird, Utah, USA. Google ScholarDigital Library
- Anna Larmo, Magnus Lindström, Michael Meyer, Ghyslain Pelletier, Johan Torsner, and Henning Wiemann. 2009. The LTE link-layer design. IEEE Communications magazine Vol. 47, 4 (2009). Google ScholarDigital Library
- Kyungmin Lee, David Chu, Eduardo Cuervo, Johannes Kopf, Yury Degtyarev, Sergey Grizan, Alec Wolman, and Jason Flinn. 2015. Outatime: Using speculation to enable low-latency continuous interaction for mobile cloud gaming ACM Mobisys. 14--17.Google ScholarDigital Library
- Yuanjie Li, Chunyi Peng, Zengwen Yuan, Jiayao Li, Haotian Deng, and Tao Wang. 2016. MobileInsight: Extracting and Analyzing Cellular Network Information on Smartphones The 22nd ACM Annual International Conference on Mobile Computing and Networking (Mobicom'16). New York, USA. Google ScholarDigital Library
- Yuanjie Li, Zengwen Yuan, and Chunyi Peng. 2017. A Control-Plane Perspective on Reducing Data Access Latency in LTE Networks ACM Mobicom. Snowbird, Utah, USA. Google ScholarDigital Library
- Justin Manweiler, Sharad Agarwal, Ming Zhang, Romit Roy Choudhury, and Paramvir Bahl. 2011. Switchboard: a matchmaking system for multiplayer mobile games ACM MobiSys. New York, NY, USA, 71--84. Google ScholarDigital Library
- Microsoft. 2016. Does Microsoft have plan to add 4G or LTE to Hololens? https://forums.hololens.com/discussion/93/does-microsoft-have-plan-to-add-4g-or-lte-to-hololens. (2016).Google Scholar
- MobileInsight. 2017. MobileInsight. (May. 2017). http://metro.cs.ucla.edu/mobile_insightGoogle Scholar
- NGMN. 2015. NGMN 5G white paper. https://www.ngmn.org/uploads/media/NGMN_5G_White_Paper_V1_0.pdf. (2015).Google Scholar
- Navid Nikaein, Mahesh K Marina, Saravana Manickam, Alex Dawson, Raymond Knopp, and Christian Bonnet. 2014. OpenAirInterface: A Flexible Platform for 5G Research. ACM SIGCOMM Computer Communication Review Vol. 44, 5 (2014), 33--38. Google ScholarDigital Library
- NVIDIA. 2017. Nvidia GRID cloud gaming platform. http://www.nvidia.com/object/cloud-gaming.html. (2017).Google Scholar
- OpenAirInterface. 2017. OpenAirInterface Project. (2017). https://twiki.eurecom.fr/twiki/bin/view/OpenAirInterfaceGoogle Scholar
- OpenSignal. 2016. The State of LTE (November 2016). https://opensignal.com/reports/2016/11/state-of-lte. (2016).Google Scholar
- Anjul Patney, Marco Salvi, Joohwan Kim, Anton Kaplanyan, Chris Wyman, Nir Benty, David Luebke, and Aaron Lefohn. 2016. Towards foveated rendering for gaze-tracked virtual reality. ACM Transactions on Graphics Vol. 35, 6 (2016), 179. Google ScholarDigital Library
- Sony Playstation. 2017. PlayStation Now: Stream PS4 Games in 2017. http://blog.us.playstation.com/2017/03/13/playstation-now-stream-ps4-games-in-2017/. (2017).Google Scholar
- Feng Qian, Lusheng Ji, Bo Han, and Vijay Gopalakrishnan. 2016. Optimizing 360 Video Delivery over Cellular Networks ACM Workshop on All Things Cellular: Operations, Applications and Challenges. New York, NY, USA, 1--6. Google ScholarDigital Library
- Feng Qian, Zhaoguang Wang, Alexandre Gerber, Zhuoqing Mao, Subhabrata Sen, and Oliver Spatscheck. 2010. Characterizing Radio Resource Allocation for 3G Networks ACM IMC. New York, NY, USA, 137--150. Google ScholarDigital Library
- Qualcomm. 2016. Making immersive virtual reality possible in mobile. https://www.qualcomm.com/documents/making-immersive-virtual-reality-possible-mobile. (2016).Google Scholar
- Qualcomm. 2017. Qualcomm Chipchode Software: Radio Firmware Source. https://createpoint.qti.qualcomm.com/dashboard/public/productkit#public/product-kit/search. (2017).Google Scholar
- RiftCat. 2017. VRidge - Play PC VR on your Cardboard. https://riftcat.com/vridge. (2017).Google Scholar
- Sanae Rosen, Haokun Luo, Qi Alfred Chen, Z Morley Mao, Jie Hui, Aaron Drake, and Kevin Lau. 2014. Discovering fine-grained RRC state dynamics and performance impacts in cellular networks ACM MobiCom. New York, NY, USA, 177--188. Google ScholarDigital Library
- Samsung. 2017. Samsung Gear VR. http://www.samsung.com/global/galaxy/gear-vr/. (2017).Google Scholar
- Shu Shi, Cheng-Hsin Hsu, Klara Nahrstedt, and Roy Campbell. 2011. Using Graphics Rendering Contexts to Enhance the Real-time Video Coding for Mobile Cloud Gaming ACM MM. New York, NY, USA, 103--112. Google ScholarDigital Library
- SK Telecom. 2015. SK Telecom's 5G Architecture Design and Implementation Guidelines. http://www.sktelecom.com/img/pds/press/151020z_5G_architecture_design_and_implementation_guideline.PDF. (2015).Google Scholar
- Wen Tong. 2017. The Blueprint of 5G IEEE International Conference on Communications. IEEE.Google Scholar
- VRScout. 2017. Report: Global VR Hardware Revenue To Hit $3.6 Billion in 2017. https://vrscout.com/news/global-vr-hardware-revenue-forecaset/. (Feb. 2017).Google Scholar
- Keith Winstein, Anirudh Sivaraman, Hari Balakrishnan, et almbox.. 2013. Stochastic Forecasts Achieve High Throughput and Low Delay over Cellular Networks. USENIX NSDI. Lombard, IL, 459--471. Google ScholarDigital Library
- NSF Workshop. 2017. NSF Follow-on Workshop on Ultra-Low Latency Wireless Networks. http://inlab.lab.asu.edu/nsf/files/WorkshopReport-2.pdf. (2017).Google Scholar
- Xiufeng Xie, Xinyu Zhang, Swarun Kumar, and Li Erran Li. 2015. pistream: Physical layer informed adaptive video streaming over lte ACM MobiCom. New York, NY, USA, 413--425. Google ScholarDigital Library
- Matt Yu, Haricharan Lakshman, and Bernd Girod. 2015. Content adaptive representations of omnidirectional videos for cinematic virtual reality ACM Workshop on Immersive Media Experiences. New York, NY, USA, 1--6. Google ScholarDigital Library
- Yasir Zaki, Thomas Pötsch, Jay Chen, Lakshminarayanan Subramanian, and Carmelita Görg. 2015. Adaptive Congestion Control for Unpredictable Cellular Networks ACM SIGCOMM. New York, NY, USA, 509--522. Google ScholarDigital Library
- Shunqing Zhang, Xiuqiang Xu, Yiqun Wu, and Lei Lu. 2014. 5G: Towards energy-efficient, low-latency and high-reliable communications networks IEEE ICCS. Macau, China, 197--201.Google Scholar
- Pingping Zong. 2016. 5G and Path to 5G. http://www.samsung.com/global/business/networks/events/Silicon-Valley-5G-Summit/attachments/S5_Intel_Pingping-Zong.pdf. (2016).Google Scholar
Index Terms
- Supporting Mobile VR in LTE Networks: How Close Are We?
Recommendations
Supporting Mobile VR in LTE Networks: How Close Are We?
SIGMETRICS '18In recent years, we have witnessed a boom in virtual reality (VR). 21 million wearable VR headsets are projected to be shipped in 2017, resulting in $4.9 billion revenue [3]. Among all the options, the mobile VR empowered by phones is most popular, ...
Supporting Mobile VR in LTE Networks: How Close Are We?
SIGMETRICS '18: Abstracts of the 2018 ACM International Conference on Measurement and Modeling of Computer SystemsIn recent years, we have witnessed a boom in virtual reality (VR). 21 million wearable VR headsets are projected to be shipped in 2017, resulting in $4.9 billion revenue [3]. Among all the options, the mobile VR empowered by phones is most popular, ...
A seamless handover scheme in IPv6-based mobile networks
With the rapid development of wireless technologies, the need to support moving hosts of IPv6-based mobile networks in ubiquitous is growing. Various well-known approaches to optimising the handover latency have been proposed in the literature: MIPv6, ...
Comments