6DoF – AR/VR & Volumetric Video

6DoF – AR/VR & Volumetric Video

Affordable content creation for free-viewpoint video and VR/AR applications

Affordable content creation for free-viewpoint video and VR/AR applications

Abstract: We present a scalable pipeline for Free-Viewpoint Video (FVV) content creation, considering also visualisation in Augmented Reality (AR) and Virtual Reality (VR). We support a range of scenarios where ...
Analysis of Intended Viewing Area vs Estimated Saliency on Narrative Plot Structures in VR Film

Analysis of Intended Viewing Area vs Estimated Saliency on Narrative Plot Structures in VR Film

In cinematic virtual reality one of the primary challenges from a storytelling perceptive is that of leading the attention of the viewers to ensure that the narrative is understood as ...
Autonomous Tracking For Volumetric Video Sequences

Autonomous Tracking For Volumetric Video Sequences

We present a robust, autonomous method for tracking volumetric sequences which can detect missing geometry and propagate user edits. Pictured left to right are step-by-step visualizations of the process. The ...
CatNet: Class Incremental 3D ConvNets for Lifelong Egocentric Gesture Recognition

CatNet: Class Incremental 3D ConvNets for Lifelong Egocentric Gesture Recognition

Abstract Egocentric gestures are the most natural form of communication for humans to interact with wearable devices such as VR/AR helmets and glasses. A major issue in such scenarios for ...
DublinCity Dataset

DublinCity Dataset

Please click the image or here DublinCity Dataset to access the dataset! ...
Dynamic Environment Mapping for Augmented Reality Applications on Mobile Devices

Dynamic Environment Mapping for Augmented Reality Applications on Mobile Devices

Abstract Augmented Reality is a topic of foremost interest nowadays. Its main goal is to seamlessly blend virtual content in real-world scenes. Due to the lack of computational power in ...
Egocentric Gesture Recognition for Head-Mounted AR devices

Egocentric Gesture Recognition for Head-Mounted AR devices

Natural interaction with virtual objects in AR/VR environments makes for a smooth user experience. Gestures are a natural extension from real world to augmented space to achieve these interactions. Finding ...
AltspaceVR avatars

Immersive Learning in Higher Education

This research extends and builds upon V-SENSE's previous 6DoF work by exploring immersive learning practices and demonstrating workflows that enable the creation of immersive, virtual learning environments (VLEs) for social ...
Jonathan Swift - A Mixed Reality Application for Trinity Library’s Long Room

Jonathan Swift – A Mixed Reality Application for Trinity Library’s Long Room

In our first paper on the cross-reality Jonathan Swift project, Jonathan Swift: Augmented Reality Application for Trinity Library’s Long Room, we describe the project's use of cutting-edge volumetric video (VV) ...
Optimization of Occlusion-Inducing Depth Pixels in 3-D Video Coding

Optimization of Occlusion-Inducing Depth Pixels in 3-D Video Coding

Abstract The optimization of occlusion-inducing depth pixels in depth map coding has received little attention in the literature, since their associated texture pixels are occluded in the synthesized view and ...
Quality Assessment for Volumetric Video Compression

Quality Assessment for Volumetric Video Compression

Volumetric video (VV) pipelines reached a high level of maturity, creating interest to use such content in interactive visualization scenarios. Volumetric video allows real-world content to be captured and represented as ...
Simultaneous Segmentation and Recognition: Towards more accurate Ego Gesture Recognition

Simultaneous Segmentation and Recognition: Towards more accurate Ego Gesture Recognition

Ego hand gestures can be used as an interface in AR and VR environments. While the context of an image is important for tasks like scene understanding, object recognition, image ...
Spatio-Temporal Upsampling for Free Viewpoint Video Point Clouds

Spatio-Temporal Upsampling for Free Viewpoint Video Point Clouds

This paper presents an approach to upsampling point cloud sequences captured through a wide baseline camera setup in a spatio-temporally consistent manner. The system uses edge-aware scene flow to understand ...
AltspaceVR selfie taken in Dublin 3D model

The Virtual Field Trip: Sharing experiences of COVID-19 through online 3D digital content.

The Impact of Covid-19: Telling your story The coronavirus disease 2019 (COVID-19) was first identified in December 2019, resulting in a sustained global pandemic. On the 29th of February 2020, ...
Frame from the film 'Luther' on top. Output from AVS360 on the bottom.

Use of Saliency Estimation in Cinematic VR Post-Production to Assist Viewer Guidance

Abstract: One of the challenges facing creators of virtual reality (VR) film is that viewers can choose to view the omnidirectional video content in any direction. Content creators do not ...
User Behaviour Analysis of Volumetric Video

User Behaviour Analysis of Volumetric Video

Volumetric video (VV) pipelines reached a high level of maturity, creating interest to use such content in interactive visualisation scenarios. Volumetric video allows real-world content to be captured and represented ...
Gareth wearing a VR HMD

Virtual Reality Games User Research (ViGUR)

This is what virtual reality is, how it works, and what it can do. Games User Research (GUR) is a field of study that provides data on the experiences of ...
VR Ulysses Live in AltSpaceVR

VR Ulysses Live in AltSpaceVR

VR Ulysses Live in AltSpaceVR was a creative project investigating the possibilities of live performance in virtual reality (VR) by exploring a section of the opening scene of James Joyce’s ...