Light fields imaging technologies

8th June 2017
Light fields imaging technologies

Light fields capture all light rays passing through a given volume of space.
Compared to traditional 2D imaging systems which capture the spatial intensity of the light rays, 4D light fields also contain the angular direction of light rays.
This additional information allows for multiple applications in different research areas such as image processing, computer vision, and computer graphics, including (but not limited to) the reconstruction of the 3D geometry of a scene, creating new images from virtual point of view, or changing the focus of an image after it is captured.
Light fields are also a growing topic of interest in the VR/AR community.

Below is an example of a light field captured with a Lytro Illum camera, which allows for refocusing and changing the perspective.

In V-SENSE, we are currently investigating novel methods for light field denoising, scene reconstruction from light field, and light field rendering.

 

2020

Alain, Martin; Smolic, Aljosa

A Spatio-Angular Binary Descriptor for Fast Light Field Inter View Matching Inproceedings Forthcoming

2020 The International Conference on Image Processing (IEEE ICIP 2020), Forthcoming.

Abstract | Links | BibTeX

Le Pendu, Mikaël ; Smolic, Aljosa

High Resolution Light Field Recovery with Fourier Disparity Layer Completion, Demosaicing, and Super-Resolution Inproceedings

IEEE Conference on Computational Imaging (ICCP), 2020.

Abstract | Links | BibTeX

Matysiak, Pierre ; Grogan, Mairéad ; Le Pendu, Mikaël ; Alain, Martin ; Zerman, Emin ; Smolic, Aljosa

High Quality Light Field Extraction and Post-Processing for Raw Plenoptic Data Journal Article

IEEE Transactions on Image Processing, 29 , pp. 4188-4203, 2020, ISSN: 1941-0042.

Abstract | Links | BibTeX

2019

Mairéad Grogan, Aljosa Smolic

L2 based Colour Correction for Light Field Arrays Inproceedings Forthcoming

In Proceedings of the 16th ACM SIGGRAPH European Conference on Visual Media Production, Forthcoming.

Links | BibTeX

Trottnow, Jonas; Spielmann, Simon; Herfet, Thorsten; Lange, Tobias; Chelli, Kelvin; Solony, Marek; Smrz, Pavel; Zemcik, Pavel; Aenchbacher, Weston; Grogan, Mairéad; Alain, Martin; Smolic, Aljosa; Canham, Trevor; Vu-Thanh, Olivier; Vázquez-Corral, Javier; Bertalmío, Marcelo

The Potential of Light Fields in Media Productions Inproceedings Forthcoming

SIGGRAPH Asia Technical Briefs, Association for Computing Machinery, Forthcoming.

Abstract | Links | BibTeX

Alain, Martin; Aenchbacher, Weston; Smolic, Aljosa

Interactive Light Field Tilt-Shift Refocus with Generalized Shift-and-Sum Inproceedings

Proceedings of European Light Field Imaging Workshop, 2019.

Abstract | Links | BibTeX

Alain, Martin; Ozcinar, Cagri; Smolic, Aljosa

A Study of Light Field Streaming for an Interactive Refocusing Application Inproceedings

2019 The International Conference on Image Processing (IEEE ICIP 2019), 2019.

Links | BibTeX

Dib, Elian; Le Pendu, Mikael ; Guillemot, Christine

Light Field Compression using Fourier Disparity Layers Conference

IEEE International Conference on Image Processing (ICIP 2019), 2019.

Abstract | Links | BibTeX

Le Pendu, Mikael ; Guillemot, Christine; Smolic, Aljosa

A Fourier Disparity Layer representation for Light Fields Journal Article

IEEE Transactions on Image Processing, 2019.

Abstract | Links | BibTeX

2018

Ganter, David; Alain, Martin; Hardman, David; Smolic, Aljoscha; Manzke, Michael

Light-Field Volume Rendering on GPU for Streaming Time-Varying Data Conference

Pacific Graphics (PG 2018), 2018.

BibTeX

Alain, Martin; Smolic, Aljosa

Light Field Super-Resolution via LFBM5D Sparse Coding Conference

IEEE International Conference on Image Processing (ICIP 2018), 2018.

Abstract | Links | BibTeX

Matysiak, Pierre; Grogan, Mairéad; Le Pendu, Mikaël ; Alain, Martin; Smolic, Aljosa

A pipeline for lenslet light field quality enhancement Conference

IEEE International Conference on Image Processing (ICIP 2018), 2018.

Abstract | Links | BibTeX

Le Pendu, Mikael ; Guillemot, Christine; Smolic, Aljosa

High Dynamic Range Light Fields via Weighted Low Rank Approximation Conference

IEEE International Conference on Image Processing (ICIP 2018), 2018.

Abstract | Links | BibTeX

2017

Alain, Martin; Smolic, Aljosa

Light Field Denoising by Sparse 5D Transform Domain Collaborative Filtering Inproceedings

IEEE International Workshop on Multimedia Signal Processing (MMSP 2017) - Top 10% Paper Award, 2017.

Abstract | Links | BibTeX

Chen, Yang; Alain, Martin; Smolic, Aljosa

Fast and Accurate Optical Flow based Depth Map Estimation from Light Fields Inproceedings

Irish Machine Vision and Image Processing Conference (Received the Best Paper Award), 2017.

Abstract | Links | BibTeX