Visual Attention-Aware Omnidirectional Video Streaming Using Optimal Tiles for Virtual Reality

21st January 2019
Visual Attention-Aware Omnidirectional Video Streaming Using Optimal Tiles for Virtual Reality


Owing to its interactive look around nature and very large resolution requirement, providing immersive omnidirectional video (ODV) streaming experiences in virtual reality (VR) applications demands cost-effective solutions to meet both the content delivery network and device constraints. In this paper, we introduce an adaptive omnidirectional video (ODV) streaming pipeline that optimizes DASH representations of ODV content considering their visual attention (VA) maps. The main contribution of this paper is the use of VA maps: (i) to compute a novel objective quality metric that captures the fact that not all of the ODV is actually watched by users: the visual attention spherical weighted (VASW)-based objective quality measurement, (ii) to define optimal tile representations of the ODV frames, namely tiling schemes, which are composed of variable-sized and non-overlapping tiles, and (iii) to efficiently distribute a given bitrate budget among the set of tiles within a tiling scheme for an ODV. We evaluate the proposed system performance with varying bandwidth conditions and the tracked head orientations from user experiments. Results show that the proposed system significantly outperforms the existing non-tiled and tile-based streaming solutions.


Paper accepted in IEEE Journal on Emerging and Selected Topics in Circuits and Systems: Special issue on Immersive Video Coding and Transmission



Please cite our paper in your publications if it helps your research:


This publication has emanated from research conducted with the financial support of Science Foundation Ireland (SFI) under the Grant Number 15/RP/2776. This work has also been partially supported by the Ministerio de Econom\’ia, Industria y Competitividad (AEI/FEDER) of the Spanish Government under project TEC2016-75981 (IVME).


If you have any question, send an e-mail at