A Novel Virtual View Quality Enhancement Technique through a Learning of Synthesised Video

Research output: Book chapter/Published conference paperConference paper

2 Citations (Scopus)

Abstract

With the development of displaying techniques, free viewpoint video (FVV) system shows its potential to provide immersive perceptual feeling by changing viewpoints. To provide this luxury, a large number of high quality views have to be synthesised from limited number of viewpoints. However, in this process, a portion of the background is occluded by the foreground object in the generated synthesised videos. Recent techniques, i.e. view synthesized prediction using Gaussian model (VSPGM) and adaptive weighting between warped and learned foregrounds indicate that learning techniques may fill occluded areas almost correctly. However, these techniques use temporal correlation by assuming that original texture of the target viewpoint are already available to fill up occluded areas which is not a practical solution. Moreover, if a pixel position experiences foreground once during learning, the existing techniques considered it as foreground throughout the process. However, the actual fact is that after experiencing a foreground a pixel position can be background again. To address the aforementioned issues, in the proposed view synthesise technique, we apply Gaussian mixture modelling (GMM) on the output images of inverse mapping (IM) technique for further improving the quality of the synthesised videos. In this technique, the foreground and background pixel intensities are refined from adaptive weights of the output of inverse mapping and the pixel intensities from the corresponding model(s) of the GMM. This technique provides a better pixel correspondence, which improves 0.10~0.46dB PSNR compared to the IM technique.
Original languageEnglish
Title of host publicationProceedings of the 2017 International Conference on Digital Image Computing: Techniques and Applications
Place of PublicationUnited States
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages1-5
Number of pages5
ISBN (Electronic)9781538628393
ISBN (Print)9781538628409
DOIs
Publication statusPublished - 21 Dec 2017
Event2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA) - Novotel Sydney Manly Pacific, Sydney, Australia
Duration: 29 Nov 201701 Dec 2017
http://dicta2017.dictaconference.org/index.html (Conference website)
http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=8226656 (Conference proceedings)

Conference

Conference2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA)
CountryAustralia
CitySydney
Period29/11/1701/12/17
OtherThe International Conference on Digital Image Computing: Techniques and Applications (DICTA) is the main Australian Conference on computer vision, image processing, pattern recognition, and related areas. DICTA was established in 1991 as the premier conference of the Australian Pattern Recognition Society (APRS).
Internet address

Fingerprint Dive into the research topics of 'A Novel Virtual View Quality Enhancement Technique through a Learning of Synthesised Video'. Together they form a unique fingerprint.

  • Cite this

    Rahaman, D. M. M., & Paul, M. (2017). A Novel Virtual View Quality Enhancement Technique through a Learning of Synthesised Video. In Proceedings of the 2017 International Conference on Digital Image Computing: Techniques and Applications (pp. 1-5). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/DICTA.2017.8227397