3DoF – 360 VR Video
A Framework for Quality Control in Cinematic VR Based on Voronoi Patches and Saliency
Abstract: In this paper, we present a novel framework for quality control in cinematic VR (360-video) based on Voronoi patches and saliency which can be used in post-production workflows. Our ...
Analysis of Intended Viewing Area vs Estimated Saliency on Narrative Plot Structures in VR Film
In cinematic virtual reality one of the primary challenges from a storytelling perceptive is that of leading the attention of the viewers to ensure that the narrative is understood as ...
Audio-visual Perception of Omnidirectional Video for Virtual Reality Applications
Fig. 1: Schematic diagram of the designed testbed. Abstract Ambisonics, which constructs a sound distribution over the full viewing sphere, improves the immersive experience in the omnidirectional video (ODV) by ...
Colour Correction for Stereoscopic Omnidirectional Images
Abstract Stereoscopic omnidirectional images (ODI) when viewed with a head-mounted display are a way to generate an immersive experience. Unfortunately, their creation is not an easy process, and different problems ...
Demo: Visual Attention for Omnidirectional Images in VR Applications
Overview: Understanding visual attention has always been a topic of great interest in different research communities. This is particularly important in omnidirectional images (ODIs) viewed with a head-mounted display (HMD), ...
Director’s Cut – Analysis of Aspects of Interactive Storytelling for VR Films
Abstract In this paper we explore methods that are currently used by professional virtual reality (VR) filmmakers to tell their stories and guide users, we analyze how end-users view 360 ...
Director’s Cut – Analysis of VR Film Cuts for Interactive Storytelling
Abstract The usage of film cuts, or transitions, is a powerful technique in interactive storytelling to express the film story by leading the viewer’s attention. To explore how existing transition ...
Director’s Cut – Visual Attention Analysis in Cinematic VR Content
In this page, we are sharing the Director's cut database that we hope will enable in creating more immersive virtual reality experience for 360° film. This page contains materials and ...
Do Users Behave Similarly in VR? Investigation of the Influence on the System Design
We are sharing our developed tools and collected user data that we hope will enable in creating more immersive virtual reality experiences. This repository is for open source codes and ...
ODIs Saliency Maps: Testbed and Dataset
Introduction: In V-Sense we are studying saliency for omnidirectional images (ODIs) in VR application. We have conducted subjective experiments to collect viewport center trajectories (VCTs) of 32 participants for 21 ...
Robust global and local color matching in stereoscopic omnidirectional content
Abstract Shooting a live-action immersive 360-degree experience, i.e. omnidirectional content (ODC) is a technological challenge as there are many technical limitations which need to be overcome, especially for capturing and ...
SalNet360: Saliency Maps for omni-directional images with CNN
Abstract The prediction of Visual Attention data from any kind of media is of valuable use to content creators and used to efficiently drive encoding algorithms. With the current trend ...
Sharpness Mismatch Detection in Stereoscopic Content with 360-Degree Capability
This page is dedicated to the paper about sharpness mismatch detection for stereoscopic omnidirectional images that was published at ICIP in 2018. Here, you can find the dataset mentioned in ...
Study on the Perception of Sharpness Mismatch in Stereoscopic Video
Abstract In this paper, we study an artifact of stereoscopic 3D (S3D) video called sharpness mismatch (SM), that occurs when one view is more blurred than the other. SM beyond ...
Super-resolution of Omnidirectional Images Using Adversarial Learning
Abstract An omnidirectional image (ODI) enables viewers to look in every direction from a fixed point through a headmounted display providing an immersive experience compared to that of a standard ...
Towards Audio-Visual Saliency Prediction for Omnidirectional Video with Spatial Audio
Abstract Omnidirectional videos (ODVs) with spatial audio enable viewers to perceive 360° directions of audio and visual signals during the consumption of ODVs with head-mounted displays (HMDs). By predicting salient ...
Towards generating ambisonics using audio-visual cue for virtual reality
Abstract Ambisonics i.e., a full-sphere surround sound, is quintessential with 360-degree visual content to provide a realistic virtual reality (VR) experience. While 360-degree visual content capture gained a tremendous boost ...
Transformer-based Long-Term Viewport Prediction in 360° Video: Scanpath is All You Need
Fig. 1: Illustration of viewport prediction in 360° video. Our model aims to predict the viewport scanpath in the forthcoming F seconds given the past H-second viewport scanpath. Abstract Virtual ...
Use of Saliency Estimation in Cinematic VR Post-Production to Assist Viewer Guidance
Abstract: One of the challenges facing creators of virtual reality (VR) film is that viewers can choose to view the omnidirectional video content in any direction. Content creators do not ...
Video Coding and Streaming for Virtual Reality
With technical advances in virtual reality (VR) devices, the media technology field is evolving toward providing immersive VR video experiences. To this end, the 360-degree video, which can be rendered by ...
Visual Attention in Omnidirectional Video for Virtual Reality Applications
We are sharing our developed test-bed and captured user data that we hope will enable in creating more immersive virtual reality experiences. This repository is for open source codes and ...
Visual Attention-Aware Omnidirectional Video Streaming Using Optimal Tiles for Virtual Reality
Abstract Owing to its interactive look around nature and very large resolution requirement, providing immersive omnidirectional video (ODV) streaming experiences in virtual reality (VR) applications demands cost-effective solutions to meet ...
VIVA-Q: Voronoi-based Quality Assessment Framework for Omnidirectional Video
This webpage is dedicated to the publications about our quality assessment framework for omnidirectional video. Here, you can find the publications and the related publicly available material. Citations Please cite ...
vsenseODVQ | V-SENSE Omnidirectional Video Quality Database
Omnidirectional video (also known as 360-degree video) is spherical in nature, as it represents all the light rays converging on a fixed point in space. Due to this spherical nature, ...