A Novel No-reference Subjective Quality Metric for Free Viewpoint Video Using Human Eye Movement

Pallab Kanti Podder, Manoranjan Paul, Manzur Murshed

Research output: Book chapter/Published conference paperConference paper

Abstract

The free viewpoint video (FVV) allows users to interactively control the viewpoint and generate new views of a dynamic scene from any 3D position for better 3D visual experience with depth perception. Multiview video coding exploits both texture and depth video information from various angles to encode a number of views to facilitate FVV. The usual practice for the single view or multiview quality assessment is characterized by evolving the objective quality assessment metrics due to their simplicity and real time applications such as the peak signal-to-noise ratio (PSNR) or the structural similarity index (SSIM). However, the PSNR or SSIM requires reference image for quality evaluation and could not be successfully employed in FVV as the new view in FVV does not have any reference view to compare with. Conversely, the widely used subjective estimator- mean opinion score (MOS) is often biased by the testing environment, viewers mode, domain knowledge, and many other factors that may actively influence on actual assessment. To address this limitation, in this work, we devise a no-reference subjective quality assessment metric by simply exploiting the pattern of human eye browsing on FVV. Over different quality contents of FVV, the participants eye-tracker recorded spatio-temporal gaze-data indicate more concentrated eye-traversing approach for relatively better quality. Thus, we calculate the Length, Angle, Pupil-size, and Gaze-duration features from the recorded gaze trajectory. The content and resolution invariant operation is carried out prior to synthesizing them using an adaptive weighted function to develop a new quality metric using eye traversal (QMET). Tested results reveal that the proposed QMET performs better than the SSIM and MOS in terms of assessing different aspects of coded video quality for a wide range of FVV contents.
Original languageEnglish
Title of host publicationImage and Video Technology
Subtitle of host publication8th Pacific-Rim Symposium (PSIVT 2017) Revised Selected Papers
EditorsManoranjan Paul, Carlos Hitoshi, Qingming Huang
Place of PublicationSwitzerland
PublisherSpringer
Pages237-251
Number of pages15
Volume10749
ISBN (Electronic)9783319757865
ISBN (Print)9783319757858
Publication statusPublished - 2018
Event8th Pacific-Rim Symposium on Image and Video Technology: PSIVT 2017 - Yifu International Convention Center, Wuhan, China
Duration: 20 Nov 201724 Nov 2017
http://www.psivt2017.org/ (Conference website)

Publication series

NameLecture Notes in Computer Science
PublisherSpringer
Volume10749
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference8th Pacific-Rim Symposium on Image and Video Technology
CountryChina
CityWuhan
Period20/11/1724/11/17
OtherThe Pacific-Rim Symposium on Image and Video Technology (PSIVT) is a high-quality series of symposia that aim at providing a forum for researchers and practitioners who are being involved, or are contributing to theoretical advances or practical implementations in image and video technology.

Previous issues of PSIVT have been held at Hsinchu, Taiwan (2006), Santiago, Chile(2007), Tokyo, Japan (2009), Gwangju, South Korea (2011), Singapore (2010), Guanajuato, Mexico (2013), and Auckland, New Zealand (2015). This eighth issue is being held at Wuhan, China.
Internet address

Fingerprint Dive into the research topics of 'A Novel No-reference Subjective Quality Metric for Free Viewpoint Video Using Human Eye Movement'. Together they form a unique fingerprint.

  • Cite this

    Podder, P. K., Paul, M., & Murshed, M. (2018). A Novel No-reference Subjective Quality Metric for Free Viewpoint Video Using Human Eye Movement. In M. Paul, C. Hitoshi, & Q. Huang (Eds.), Image and Video Technology: 8th Pacific-Rim Symposium (PSIVT 2017) Revised Selected Papers (Vol. 10749, pp. 237-251). (Lecture Notes in Computer Science; Vol. 10749). Springer. https://link.springer.com/chapter/10.1007/978-3-319-75786-5_20