Event synthesis for light field videos using recurrent neural networks

Zhicheng Lu, Xiaoming Chen, Yuk Ying Chung, Sen Liu

Research output: Other contribution to conferencePosterpeer-review

1 Citation (Scopus)

Abstract

Light field videos (LFVs), consisting of multiple angles of view, yield higher complexity in performing computer vision tasks. The emerging event cameras offer a new means for light-weight processing of LFVs, but it is infeasible to build an LFV capturing device with multiple event cameras due to their high costs. In this poster, we propose a novel 'event synthesis for light field videos' (ES4LFV) model by using recurrent neural networks and build a preliminary dataset for training. The ES4LFV can synthesize events for light field video (E-LFV) from LFV camera array and single event camera. The experimental results show that ES4LFV outperforms the traditional method by 3.1dB in PSNR.

Original languageEnglish
Pages816-817
Number of pages2
DOIs
Publication statusPublished - 2022
EventThe 29th IEEE Conference on Virtual Reality & 3D User Interfaces: IEEE VR 2022 - Virtual, Online, New Zealand
Duration: 12 Mar 202216 Mar 2022
https://ieeevr.org/2022/ (Conference website)
https://ieeexplore.ieee.org/xpl/conhome/9757254/proceeding (Proceedings)

Conference

ConferenceThe 29th IEEE Conference on Virtual Reality & 3D User Interfaces
Country/TerritoryNew Zealand
CityOnline
Period12/03/2216/03/22
OtherThe IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR) is the premier international event for the presentation of research results in the broad areas of virtual, augmented, and mixed reality (VR/AR/XR). Since 1993, IEEE VR has presented groundbreaking research and accomplishments by virtual reality pioneers: scientists, engineers, designers, and artists, paving the way for the future. Soon, IEEE VR expanded its scope to also include augmented, mixed, and other forms of mediated reality. Similarly, the IEEE Symposium on 3D User Interfaces (3DUI), which started as a workshop at IEEE VR in 2004, has become the premier venue for 3D user interfaces and 3D interaction in virtual environments. In 2018, VR and 3DUI were merged into the IEEE Conference on Virtual Reality and 3D User Interfaces, with the short name IEEE VR. In 2020, VR was the first major IEEE conference to be held entirely online and in a virtual environment.
Internet address

Fingerprint

Dive into the research topics of 'Event synthesis for light field videos using recurrent neural networks'. Together they form a unique fingerprint.

Cite this