With technical advances in virtual reality (VR) devices, the media technology field is evolving toward providing immersive VR video experiences. To this end, the 360-degree video, which can be rendered by modern head-mounted displays for VR at a sufficiently high frame-rate and resolution, is attracting an increasing amount of attention in the context of VR video applications.
Given the significant video consumer growth of demand for VR, delivery of 360-degree video is one of the most important fields that require cost-effective solutions to achieve widespread proliferation of VR technology. Considering its data-intensive representation and the best-effort nature of the Internet, delivery of 360-degree videos requires advanced video coding and streaming techniques to offer an enhanced VR experience.
In the V-SENSE project, we are investigating novel compression and streaming techniques applied to the 360-degree video.
2018
|
Ozcinar, Cagri; Cabrera, Julian; Smolic, Aljosa Omnidirectional Video Streaming Using Visual Attention-Driven Dynamic Tiling for VR Inproceedings IEEE International Conference on Visual Communications and Image Processing (VCIP) 2018, Taichung, Taiwan, 2018. Links | BibTeX @inproceedings{Ozcinar2018b,
title = {Omnidirectional Video Streaming Using Visual Attention-Driven Dynamic Tiling for VR},
author = {Cagri Ozcinar and Julian Cabrera and Aljosa Smolic},
url = {https://v-sense.scss.tcd.ie/research/3dof/360-degree-video-coding-and-streaming-for-virtual-reality/},
year = {2018},
date = {2018-12-09},
booktitle = {IEEE International Conference on Visual Communications and Image Processing (VCIP) 2018},
address = {Taichung, Taiwan},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
|
Ozcinar, Cagri; Cabrera, Julian; Smolic, Aljosa Viewport-aware omnidirectional video streaming using visual attention and dynamic tiles Inproceedings 7-th European Workshop on Visual Information Processing (EUVIP) 2018, 2018. Links | BibTeX @inproceedings{Ozcinar2018c,
title = {Viewport-aware omnidirectional video streaming using visual attention and dynamic tiles},
author = {Cagri Ozcinar and Julian Cabrera and Aljosa Smolic},
url = {https://v-sense.scss.tcd.ie/?p=519},
year = {2018},
date = {2018-11-27},
booktitle = {7-th European Workshop on Visual Information Processing (EUVIP) 2018},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
|
2017
|
Ozcinar, Cagri; Abreu, Ana De; Knorr, Sebastian; Smolic, Aljosa Estimation of optimal encoding ladders for tiled 360° VR video in adaptive streaming systems Inproceedings The 19th IEEE International Symposium on Multimedia (ISM 2017), Taichung, Taiwan, 2017. Links | BibTeX @inproceedings{OzcinarISM2017,
title = {Estimation of optimal encoding ladders for tiled 360° VR video in adaptive streaming systems},
author = { Cagri Ozcinar and Ana De Abreu and Sebastian Knorr and Aljosa Smolic},
url = {https://v-sense.scss.tcd.ie/wp-content/uploads/2018/02/ISM_2017_pcopy.pdf
http://ieeexplore.ieee.org/document/8241580/
https://arxiv.org/pdf/1711.03362.pdf
https://www.researchgate.net/publication/320274287_Estimation_of_Optimal_Encoding_Ladders_for_Tiled_360_VR_Video_in_Adaptive_Streaming_Systems?tab=overview},
year = {2017},
date = {2017-12-11},
booktitle = {The 19th IEEE International Symposium on Multimedia (ISM 2017)},
address = {Taichung, Taiwan},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
|
Ozcinar, Cagri; Abreu, Ana De; Smolic, Aljosa Viewport-aware adaptive 360° video streaming using tiles for virtual reality Inproceedings 2017 IEEE International Conference on Image Processing (ICIP), pp. 2174-2178, Beijing, China, 2017, ISBN: 2381-8549. Abstract | Links | BibTeX @inproceedings{Ozcinar2017,
title = {Viewport-aware adaptive 360° video streaming using tiles for virtual reality},
author = { Cagri Ozcinar and Ana De Abreu and Aljosa Smolic},
url = {https://www.researchgate.net/publication/316990176_VIEWPORT-AWARE_ADAPTIVE_360_VIDEO_STREAMING_USING_TILES_FOR_VIRTUAL_REALITY
http://ieeexplore.ieee.org/document/8296667/
https://arxiv.org/pdf/1711.02386.pdf
},
doi = {10.1109/ICIP.2017.8296667},
isbn = {2381-8549},
year = {2017},
date = {2017-09-30},
booktitle = {2017 IEEE International Conference on Image Processing (ICIP)},
pages = {2174-2178},
address = {Beijing, China},
abstract = {360◦ video is attracting an increasing amount of atten- tion in the context of Virtual Reality (VR). Owing to its very high-resolution requirements, existing professional stream- ing services for 360◦ video suffer from severe drawbacks. This paper introduces a novel end-to-end streaming system from encoding to displaying, to transmit 8K resolution 360◦ video and to provide an enhanced VR experience using Head Mounted Displays (HMDs). The main contributions of the proposed system are about tiling, integration of the MPEG- Dynamic Adaptive Streaming over HTTP (DASH) standard, and viewport-aware bitrate level selection. Tiling and adap- tive streaming enable the proposed system to deliver very high-resolution 360◦ video at good visual quality. Further, the proposed viewport-aware bitrate assignment selects an optimum DASH representation for each tile in a viewport-aware manner. The quality performance of the proposed system is verified in simulations with varying network band- width using realistic view trajectories recorded from user experiments. Our results show that the proposed streaming system compares favorably compared to existing methods in terms of PSNR and SSIM inside the viewport.
Our streaming system is available as an open source library .},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
360◦ video is attracting an increasing amount of atten- tion in the context of Virtual Reality (VR). Owing to its very high-resolution requirements, existing professional stream- ing services for 360◦ video suffer from severe drawbacks. This paper introduces a novel end-to-end streaming system from encoding to displaying, to transmit 8K resolution 360◦ video and to provide an enhanced VR experience using Head Mounted Displays (HMDs). The main contributions of the proposed system are about tiling, integration of the MPEG- Dynamic Adaptive Streaming over HTTP (DASH) standard, and viewport-aware bitrate level selection. Tiling and adap- tive streaming enable the proposed system to deliver very high-resolution 360◦ video at good visual quality. Further, the proposed viewport-aware bitrate assignment selects an optimum DASH representation for each tile in a viewport-aware manner. The quality performance of the proposed system is verified in simulations with varying network band- width using realistic view trajectories recorded from user experiments. Our results show that the proposed streaming system compares favorably compared to existing methods in terms of PSNR and SSIM inside the viewport.
Our streaming system is available as an open source library . |
