The free viewpoint video (FVV) allows users to interactively control the viewpoint and generate new views of a dynamic scene from any 3D position for better 3D visual experience with depth perception. Multiview video coding exploits both texture and depth video information from various angles to encode a number of views to facilitate FVV. The usual practice for the single view or multiview quality assessment is characterized by evolving the objective quality assessment metrics due to their simplicity and real time applications such as the peak signal-to-noise ratio (PSNR) or the structural similarity index (SSIM). However, the PSNR or SSIM requires reference image for quality evaluation and could not be successfully employed in FVV as the new view in FVV does not have any reference view to compare with. Conversely, the widely used subjective estimator- mean opinion score (MOS) is often biased by the testing environment, viewers mode, domain knowledge, and many other factors that may actively influence on actual assessment. To address this limitation, in this work, we devise a no-reference subjective quality assessment metric by simply exploiting the pattern of human eye browsing on FVV. Over different quality contents of FVV, the participants eye-tracker recorded spatio-temporal gaze-data indicate more concentrated eye-traversing approach for relatively better quality. Thus, we calculate the Length, Angle, Pupil-size, and Gaze-duration features from the recorded gaze trajectory. The content and resolution invariant operation is carried out prior to synthesizing them using an adaptive weighted function to develop a new quality metric using eye traversal (QMET). Tested results reveal that the proposed QMET performs better than the SSIM and MOS in terms of assessing different aspects of coded video quality for a wide range of FVV contents.
|Title of host publication||Image and Video Technology|
|Subtitle of host publication||8th Pacific-Rim Symposium (PSIVT 2017) Revised Selected Papers|
|Editors||Manoranjan Paul, Carlos Hitoshi, Qingming Huang|
|Place of Publication||Switzerland|
|Number of pages||15|
|Publication status||Published - 2018|
|Event||8th Pacific-Rim Symposium on Image and Video Technology: PSIVT 2017 - Yifu International Convention Center, Wuhan, China|
Duration: 20 Nov 2017 → 24 Nov 2017
http://www.psivt2017.org/ (Conference website)
|Name||Lecture Notes in Computer Science|
|Conference||8th Pacific-Rim Symposium on Image and Video Technology|
|Period||20/11/17 → 24/11/17|
|Other||The Pacific-Rim Symposium on Image and Video Technology (PSIVT) is a high-quality series of symposia that aim at providing a forum for researchers and practitioners who are being involved, or are contributing to theoretical advances or practical implementations in image and video technology. |
Previous issues of PSIVT have been held at Hsinchu, Taiwan (2006), Santiago, Chile(2007), Tokyo, Japan (2009), Gwangju, South Korea (2011), Singapore (2010), Guanajuato, Mexico (2013), and Auckland, New Zealand (2015). This eighth issue is being held at Wuhan, China.
Podder, P. K., Paul, M., & Murshed, M. (2018). A Novel No-reference Subjective Quality Metric for Free Viewpoint Video Using Human Eye Movement. In M. Paul, C. Hitoshi, & Q. Huang (Eds.), Image and Video Technology: 8th Pacific-Rim Symposium (PSIVT 2017) Revised Selected Papers (Vol. 10749, pp. 237-251). (Lecture Notes in Computer Science; Vol. 10749). Springer. https://link.springer.com/chapter/10.1007/978-3-319-75786-5_20