QualityVR

17th May 2017
QualityVR

Overview:

360-degree video, also called live-action virtual reality (VR), is one of the latest and most powerful trends in immersive media, with an increasing potential for the next decades. In particular, head-mounted display (HMD) technology like e.g. HTC Vive, Oculus Rift and Samsung Gear VR is maturing and entering professional and consumer markets. On the other side, capture devices like e.g. Facebook’s Surround 360 camera, Nokia Ozo and Google Odyssee are some of the latest technologies to capture 360-degree video in stereoscopic 3D (S3D).

However, capturing 360-degree videos is not an easy task as there are many physical limitations which need to be overcome, especially for capturing and post-processing in S3D. In general, such limitations result in artifacts which cause visual discomfort when watching the content with a HMD. The artifacts or issues can be divided into three categories: binocular rivalry issues, conflicts of depth cues and artifacts which occur in both monocular and stereoscopic 360-degree content production. Issues of the first two categories have been investigated for standard S3D content e.g. for cinema screens and 3D-TV. The third category consists of typical artifacts which only occur in multi-camera systems used for panorama capturing. As native S3D 360-degree video production is still very error-prone, especially with respect to binocular rivalry issues, many high-end S3D productions are shot in 2D 360-degree and post-converted to S3D.

Within the project QualityVR, our group is working on video analysis tools to detect, assess and partly correct artefacts which occur in stereoscopic 360-degrees video production, in particular, conflicts of depth cues and binocular rivalry issues.

Publications:

2020

Croci, Simone; Ozcinar, Cagri; Zerman, Emin; Knorr, Sebastian; Cabrera, Julian; Smolic, Aljosa

Visual Attention-Aware Quality Estimation Framework for Omnidirectional Video using Spherical Voronoi Diagram Journal Article

In: Springer Quality and User Experience, 2020.

Abstract | Links | BibTeX

2019

Croci, Simone; Ozcinar, Cagri; Zerman, Emin; Cabrera, Julian; Smolic, Aljosa

Voronoi-based Objective Quality Metrics for Omnidirectional Video Inproceedings

In: 11th International Conference on Quality of Multimedia Experience (QoMEX 2019), 2019.

Links | BibTeX

2018

Croci, Simone; Knorr, Sebastian; Smolic, Aljosa

Sharpness Mismatch Detection in Stereoscopic Content with 360-Degree Capability Inproceedings

In: IEEE International Conference on Image Processing (ICIP 2018), 2018.

Abstract | Links | BibTeX

O’Dwyer, Néill; Johnson, Nicholas

Virtual Play: Beckettian Experiments in Virtual Reality Journal Article

In: Contemporary Theatre review, vol. 28.1, 2018.

Abstract | Links | BibTeX

2017

Croci, Simone; Knorr, Sebastian; Smolic, Aljosa

Saliency-Based Sharpness Mismatch Detection For Stereoscopic Omnidirectional Images Inproceedings

In: 14th European Conference on Visual Media Production, London, UK, 2017.

Abstract | Links | BibTeX

Croci, Simone; Knorr, Sebastian; Goldmann, Lutz; Smolic, Aljosa

A Framework for Quality Control in Cinematic VR Based on Voronoi Patches and Saliency Inproceedings

In: International Conference on 3D Immersion, Brussels, Belgium, 2017.

Abstract | Links | BibTeX

Knorr, Sebastian; Croci, Simone; Smolic, Aljosa

A Modular Scheme for Artifact Detection in Stereoscopic Omni-Directional Images Inproceedings

In: Irish Machine Vision and Image Processing Conference, Maynooth, Ireland, 2017.

Abstract | Links | BibTeX