3DoF – 360 VR Video

3DoF – 360 VR Video

A Framework for Quality Control in Cinematic VR Based on Voronoi Patches and Saliency

A Framework for Quality Control in Cinematic VR Based on Voronoi Patches and Saliency

Abstract: In this paper, we present a novel framework for quality control in cinematic VR (360-video) based on Voronoi patches and saliency which can be used in post-production workflows. Our ...
Analysis of Intended Viewing Area vs Estimated Saliency on Narrative Plot Structures in VR Film

Analysis of Intended Viewing Area vs Estimated Saliency on Narrative Plot Structures in VR Film

In cinematic virtual reality one of the primary challenges from a storytelling perceptive is that of leading the attention of the viewers to ensure that the narrative is understood as ...
Audio-visual Perception of Omnidirectional Video for Virtual Reality Applications

Audio-visual Perception of Omnidirectional Video for Virtual Reality Applications

Fig. 1: Schematic diagram of the designed testbed. Abstract Ambisonics, which constructs a sound distribution over the full viewing sphere, improves the immersive experience in the omnidirectional video (ODV) by ...
Colour Correction for Stereoscopic Omnidirectional Images

Colour Correction for Stereoscopic Omnidirectional Images

Abstract Stereoscopic omnidirectional images (ODI) when viewed with a head-mounted display are a way to generate an immersive experience. Unfortunately, their creation is not an easy process, and different problems ...
Demo: Visual Attention for Omnidirectional Images in VR Applications

Demo: Visual Attention for Omnidirectional Images in VR Applications

Overview: Understanding visual attention has always been a topic of great interest in different research communities. This is particularly important in omnidirectional images (ODIs) viewed with a head-mounted display (HMD), ...
Director's Cut - Analysis of Aspects of Interactive Storytelling for VR Films

Director’s Cut – Analysis of Aspects of Interactive Storytelling for VR Films

Abstract In this paper we explore methods that are currently used by professional virtual reality (VR) filmmakers to tell their stories and guide users, we analyze how end-users view 360 ...
Director's Cut - Analysis of VR Film Cuts for Interactive Storytelling

Director’s Cut – Analysis of VR Film Cuts for Interactive Storytelling

Abstract The usage of film cuts, or transitions, is a powerful technique in interactive storytelling to express the film story by leading the viewer’s attention. To explore how existing transition ...
Director's Cut - Visual Attention Analysis in Cinematic VR Content

Director’s Cut – Visual Attention Analysis in Cinematic VR Content

In this page, we are sharing the Director's cut database that we hope will enable in creating more immersive virtual reality experience for 360° film. This page contains materials and ...
Do Users Behave Similarly in VR? Investigation of the Influence on the System Design

Do Users Behave Similarly in VR? Investigation of the Influence on the System Design

We are sharing our developed tools and collected user data that we hope will enable in creating more immersive virtual reality experiences. This repository is for open source codes and ...
ODIs Saliency Maps: Testbed and Dataset

ODIs Saliency Maps: Testbed and Dataset

Introduction: In V-Sense we are studying saliency for omnidirectional images (ODIs) in VR application. We have conducted subjective experiments to collect viewport center trajectories (VCTs) of 32 participants for 21 ...
QualityVR

QualityVR

Overview: 360-degree video, also called live-action virtual reality (VR), is one of the latest and most powerful trends in immersive media, with an increasing potential for the next decades. In ...
Robust global and local color matching in stereoscopic omnidirectional content

Robust global and local color matching in stereoscopic omnidirectional content

Abstract Shooting a live-action immersive 360-degree experience, i.e. omnidirectional content (ODC) is a technological challenge as there are many technical limitations which need to be overcome, especially for capturing and ...
SalNet360: Saliency Maps for omni-directional images with CNN

SalNet360: Saliency Maps for omni-directional images with CNN

Abstract The prediction of Visual Attention data from any kind of media is of valuable use to content creators and used to efficiently drive encoding algorithms. With the current trend ...
Sharpness Mismatch Detection in Stereoscopic Content with 360-Degree Capability

Sharpness Mismatch Detection in Stereoscopic Content with 360-Degree Capability

This page is dedicated to the paper about sharpness mismatch detection for stereoscopic omnidirectional images that was published at ICIP in 2018. Here, you can find the dataset mentioned in ...
Study on the Perception of Sharpness Mismatch in Stereoscopic Video

Study on the Perception of Sharpness Mismatch in Stereoscopic Video

Abstract In this paper, we study an artifact of stereoscopic 3D (S3D) video called sharpness mismatch (SM), that occurs when one view is more blurred than the other. SM beyond ...
Super-resolution of Omnidirectional Images Using Adversarial Learning

Super-resolution of Omnidirectional Images Using Adversarial Learning

Abstract An omnidirectional image (ODI) enables viewers to look in every direction from a fixed point through a headmounted display providing an immersive experience compared to that of a standard ...
Towards Audio-Visual Saliency Prediction for Omnidirectional Video with Spatial Audio

Towards Audio-Visual Saliency Prediction for Omnidirectional Video with Spatial Audio

Abstract Omnidirectional videos (ODVs) with spatial audio enable viewers to perceive 360° directions of audio and visual signals during the consumption of ODVs with head-mounted displays (HMDs). By predicting salient ...
Towards generating ambisonics using audio-visual cue for virtual reality

Towards generating ambisonics using audio-visual cue for virtual reality

Abstract Ambisonics i.e., a full-sphere surround sound, is quintessential with 360-degree visual content to provide a realistic virtual reality (VR) experience. While 360-degree visual content capture gained a tremendous boost ...
Transformer-based Long-Term Viewport Prediction in 360° Video: Scanpath is All You Need

Transformer-based Long-Term Viewport Prediction in 360° Video: Scanpath is All You Need

Fig. 1: Illustration of viewport prediction in 360° video. Our model aims to predict the viewport scanpath in the forthcoming F seconds given the past H-second viewport scanpath. Abstract Virtual ...
Frame from the film 'Luther' on top. Output from AVS360 on the bottom.

Use of Saliency Estimation in Cinematic VR Post-Production to Assist Viewer Guidance

Abstract: One of the challenges facing creators of virtual reality (VR) film is that viewers can choose to view the omnidirectional video content in any direction. Content creators do not ...
Video Coding and Streaming for Virtual Reality

Video Coding and Streaming for Virtual Reality

With technical advances in virtual reality (VR) devices, the media technology field is evolving toward providing immersive VR video experiences. To this end, the 360-degree video, which can be rendered by ...
Visual Attention in Omnidirectional Video for Virtual Reality Applications

Visual Attention in Omnidirectional Video for Virtual Reality Applications

We are sharing our developed test-bed and captured user data that we hope will enable in creating more immersive virtual reality experiences. This repository is for open source codes and ...
Visual Attention-Aware Omnidirectional Video Streaming Using Optimal Tiles for Virtual Reality

Visual Attention-Aware Omnidirectional Video Streaming Using Optimal Tiles for Virtual Reality

Abstract Owing to its interactive look around nature and very large resolution requirement, providing immersive omnidirectional video (ODV) streaming experiences in virtual reality (VR) applications demands cost-effective solutions to meet ...
VIVA-Q: Voronoi-based Quality Assessment Framework for Omnidirectional Video

VIVA-Q: Voronoi-based Quality Assessment Framework for Omnidirectional Video

This webpage is dedicated to the publications about our quality assessment framework for omnidirectional video. Here, you can find the publications and the related publicly available material. Citations Please cite ...
vsenseODVQ | V-SENSE Omnidirectional Video Quality Database

vsenseODVQ | V-SENSE Omnidirectional Video Quality Database

Omnidirectional video (also known as 360-degree video) is spherical in nature, as it represents all the light rays converging on a fixed point in space. Due to this spherical nature, ...