Virtual View Quality Enhancement Using Side View Information for Free Viewpoint Video

D. M.Motiur Rahaman, Manoranjan Paul, Nusrat Jahan Shoumy

Research output: Book chapter/Published conference paperConference paperpeer-review

1 Citation (Scopus)

Abstract

With the advancement of displaying technologies, virtual viewpoint video needs to be synthesized from adjacent viewpoints to provide immersive perceptual viewing experience of a scene. View synthesized techniques suffer poor rendering quality due to holes created by occlusion in the warping process. Currently, spatial and temporal correlation techniques are used to improve the quality of the synthesized view. However, spatial correlation e. g. inpainting and inverse mapping (IM) techniques cannot fill holes efficiently due to low spatial correlation in the edge between foreground and background pixels. On the other hand, the temporal correlation among already synthesized frames through learning by Gaussian mixture modelling (GMM) may fill occluded areas efficiently. However, there are no frames for GMM learning when the user switches view instantly. To address the aforementioned issues, in the proposed view synthesis technique, we apply GMM on the adjacent viewpoint videos. Then, we utilize the number of GMM models to refine pixel intensities of the synthesized view by using a weighting factor between pixel intensities in GMM models and warped images. This technique provides a better pixel correspondence, which improves 0.47~0.58dB PSNR compared to the IM technique.

Original languageEnglish
Title of host publicationVCIP 2018 - IEEE International Conference on Visual Communications and Image Processing
PublisherIEEE, Institute of Electrical and Electronics Engineers
ISBN (Electronic)9781538644584
DOIs
Publication statusPublished - 02 Jul 2018
Event33rd IEEE International Conference on Visual Communications and Image Processing, VCIP 2018 - Taichung, Taiwan, Province of China
Duration: 09 Dec 201812 Dec 2018
https://search.library.uq.edu.au/primo-explore/fulldisplay?vid=61UQ&docid=61UQ_ALMA51246594970003131&lang=en_US&context=L

Publication series

NameVCIP 2018 - IEEE International Conference on Visual Communications and Image Processing

Conference

Conference33rd IEEE International Conference on Visual Communications and Image Processing, VCIP 2018
Country/TerritoryTaiwan, Province of China
CityTaichung
Period09/12/1812/12/18
Internet address

Fingerprint

Dive into the research topics of 'Virtual View Quality Enhancement Using Side View Information for Free Viewpoint Video'. Together they form a unique fingerprint.

Cite this