Human visual field based saliency prediction method using Eye Tracker data for video summarization

Md. Musfequs Salehin, Manoranjan Paul

Research output: Book chapter/Published conference paperConference paperpeer-review

12 Citations (Scopus)
5 Downloads (Pure)

Abstract

Video summarization is the process to extract the most significant contents of a video and to represent it in a concise form so that a user can understand about all the important events of a long video. Existing methods for video summarization fails to achieve a satisfactory result for a video with camera movement and significant illumination changes.To solve this problem, a new saliency prediction method is proposed based on human visual field using human eye's fixation data obtained by Tobii X120 Eye Tracker. Three different circular regions are considered around a fixation point similar to foveal, parafoveal and peripheral regions of human visual field. The inner (foveal), middle (parafoveal),and outer (peripheral) regions are assigned highest, mid and lowest salient values respectively. The motivation is that human pay more attention in foveal region and less attention in parifoveal region. Based on this concept, a visual saliency score is calculated from eye tracker fixation data for each frame and a set of key-frames are selected based on used preferences. The proposed method is implemented on Office video dataset that contains video with camera movement and illumination change. Experimental results show superior performance compared to the existing GMM based method.
Original languageEnglish
Title of host publication2016 IEEE international conference on multimedia & expo workshop (ICMEW)
Place of PublicationUSA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages1-6
Number of pages6
ISBN (Electronic)9781509015528
ISBN (Print)9781509015535 (Print on demand)
DOIs
Publication statusPublished - 2016
EventIEEE International Conference on Multimedia and Expo (ICME) 2016 - The Westin Seattle, Seattle, United States
Duration: 11 Jul 201615 Jul 2016
https://web.archive.org/web/20160618190437/http://www.icme2016.org/ (Conference website)

Conference

ConferenceIEEE International Conference on Multimedia and Expo (ICME) 2016
Country/TerritoryUnited States
CitySeattle
Period11/07/1615/07/16
OtherThe IEEE International Conference on Multimedia & Expo (ICME) has been the flagship multimedia conference sponsored by four IEEE societies since 2000. It serves as a forum to promote the exchange of the latest advances in multimedia technologies, systems, and applications from both the research and development perspectives of the circuits and systems, communications, computer, and signal processing communities. ICME also features an Exposition of multimedia products and prototypes.
Internet address

Fingerprint

Dive into the research topics of 'Human visual field based saliency prediction method using Eye Tracker data for video summarization'. Together they form a unique fingerprint.

Cite this