A novel framework for video summarization based on smooth pursuit information from eye tracker data

Md Musfequs Salehin, Manoranjan Paul

Research output: Book chapter/Published conference paperConference paperpeer-review

9 Citations (Scopus)


Existing methods for video summarization fails to achieve a satisfactory result for a video with camera movement, low contrast, and significant illumination changes. To solve these problems, we propose a novel framework for video summarization based on the smooth pursuit which is the state of eye movement when a user follows a moving object in a video. First, we propose a new method to distinguish smooth pursuit from another type of gaze points, such as fixation and saccade. Later, we assign a probability score to each frame based on the smooth pursuit information. Finally, we select a set of key frames based on the probability score. To evaluate the proposed method, we implement it on Office video dataset that contains videos with camera movement/shaking and illumination changes. Experimental results show the superior performance compared to the single view results of the state-of-the-art GMM based method.
Original languageEnglish
Title of host publication2017 IEEE international conference on multimedia & expo workshops (ICMEW)
Place of PublicationUnited States
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages6
ISBN (Electronic)9781538605608
ISBN (Print)9781538605615 (Print on demand)
Publication statusPublished - 07 Sep 2017
EventIEEE International Conference on Multimedia and Expo (ICME) 2017 - Harbour Grand Kowloon, Hong Kong, Hong Kong
Duration: 10 Jul 201714 Jul 2017
http://www.icme2017.org/ (Conference website)
http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=8014303 (Conference proceedings (ICME 2017))
http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=8014334 (Conference proceedings (ICMEW 2017))


ConferenceIEEE International Conference on Multimedia and Expo (ICME) 2017
Abbreviated titleThe New Media Experience
Country/TerritoryHong Kong
CityHong Kong
OtherThe IEEE International Conference on Multimedia & Expo (ICME) has been the flagship multimedia conference sponsored by four IEEE societies since 2000. It serves as a forum to promote the exchange of the latest advances in multimedia technologies, systems, and applications from both the research and development perspectives of the circuits and systems, communications, computer, and signal processing communities. ICME also features an Exposition of multimedia products and prototypes. ICME 2017 is the 18th ICME conference. The main theme of 2017 is "The New Media Experience", enabling next generation 3D/AR/VR experiences and applications, based on which various sessions and events, in particular a Grand Challenge, will be organized. About 400 participants mainly from Asia, Europe and North America will gather in Hong Kong to discuss and progress latest development in multimedia technologies and related fields. This year, the best contributions to the conference will be honoured with the 10k Best Paper Award which promotes research advances in the general Multimedia related areas: Text, Graphics, Vision, Image, Video, Audio, Speech, Sensing data, and their mining, learning, processing, compression, communications, rendering, and associated innovations and applications.
Internet address


Dive into the research topics of 'A novel framework for video summarization based on smooth pursuit information from eye tracker data'. Together they form a unique fingerprint.

Cite this