With technical advances in virtual reality (VR) devices, the media technology field is evolving toward providing immersive VR video experiences. To this end, the 360-degree video, which can be rendered by modern head-mounted displays for VR at a sufficiently high frame-rate and resolution, is attracting an increasing amount of attention in the context of VR video applications.
Given the significant video consumer growth of demand for VR, delivery of 360-degree video is one of the most important fields that require cost-effective solutions to achieve widespread proliferation of VR technology. Considering its data-intensive representation and the best-effort nature of the Internet, delivery of 360-degree videos requires advanced video coding and streaming techniques to offer an enhanced VR experience.
In the V-SENSE project, we are investigating novel compression and streaming techniques applied to the 360-degree video.
2017
|
Ozcinar, Cagri; Abreu, Ana De; Knorr, Sebastian; Smolic, Aljosa Estimation of optimal encoding ladders for tiled 360° VR video in adaptive streaming systems Conference Forthcoming The 19th IEEE International Symposium on Multimedia (ISM2017), Taichung, Taiwan, Forthcoming. BibTeX @conference{OzcinarISM2017,
title = {Estimation of optimal encoding ladders for tiled 360° VR video in adaptive streaming systems},
author = { Cagri Ozcinar and Ana De Abreu and Sebastian Knorr and Aljosa Smolic},
year = {2017},
date = {2017-12-20},
booktitle = {The 19th IEEE International Symposium on Multimedia (ISM2017)},
address = {Taichung, Taiwan},
keywords = {},
pubstate = {forthcoming},
tppubtype = {conference}
}
|
Ozcinar, Cagri; Abreu, Ana De; Smolic, Aljosa Viewport-aware adaptive 360° video streaming using tiles for virtual reality Inproceedings 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China, 2017. Abstract | Links | BibTeX @inproceedings{Ozcinar2017,
title = {Viewport-aware adaptive 360° video streaming using tiles for virtual reality},
author = { Cagri Ozcinar and Ana De Abreu and Aljosa Smolic},
url = {https://www.researchgate.net/publication/316990176_VIEWPORT-AWARE_ADAPTIVE_360_VIDEO_STREAMING_USING_TILES_FOR_VIRTUAL_REALITY},
year = {2017},
date = {2017-09-30},
booktitle = {2017 IEEE International Conference on Image Processing (ICIP)},
address = {Beijing, China},
abstract = {360◦ video is attracting an increasing amount of atten- tion in the context of Virtual Reality (VR). Owing to its very high-resolution requirements, existing professional stream- ing services for 360◦ video suffer from severe drawbacks. This paper introduces a novel end-to-end streaming system from encoding to displaying, to transmit 8K resolution 360◦ video and to provide an enhanced VR experience using Head Mounted Displays (HMDs). The main contributions of the proposed system are about tiling, integration of the MPEG- Dynamic Adaptive Streaming over HTTP (DASH) standard, and viewport-aware bitrate level selection. Tiling and adap- tive streaming enable the proposed system to deliver very high-resolution 360◦ video at good visual quality. Further, the proposed viewport-aware bitrate assignment selects an optimum DASH representation for each tile in a viewport-aware manner. The quality performance of the proposed system is verified in simulations with varying network band- width using realistic view trajectories recorded from user experiments. Our results show that the proposed streaming system compares favorably compared to existing methods in terms of PSNR and SSIM inside the viewport.
Our streaming system is available as an open source library .},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
360◦ video is attracting an increasing amount of atten- tion in the context of Virtual Reality (VR). Owing to its very high-resolution requirements, existing professional stream- ing services for 360◦ video suffer from severe drawbacks. This paper introduces a novel end-to-end streaming system from encoding to displaying, to transmit 8K resolution 360◦ video and to provide an enhanced VR experience using Head Mounted Displays (HMDs). The main contributions of the proposed system are about tiling, integration of the MPEG- Dynamic Adaptive Streaming over HTTP (DASH) standard, and viewport-aware bitrate level selection. Tiling and adap- tive streaming enable the proposed system to deliver very high-resolution 360◦ video at good visual quality. Further, the proposed viewport-aware bitrate assignment selects an optimum DASH representation for each tile in a viewport-aware manner. The quality performance of the proposed system is verified in simulations with varying network band- width using realistic view trajectories recorded from user experiments. Our results show that the proposed streaming system compares favorably compared to existing methods in terms of PSNR and SSIM inside the viewport.
Our streaming system is available as an open source library . |
