Abstract
Existing methods for video summarization fails to achieve a satisfactory result for a video with camera movement, low contrast, and significant illumination changes. To solve these problems, we propose a novel framework for video summarization based on the smooth pursuit which is the state of eye movement when a user follows a moving object in a video. First, we propose a new method to distinguish smooth pursuit from another type of gaze points, such as fixation and saccade. Later, we assign a probability score to each frame based on the smooth pursuit information. Finally, we select a set of key frames based on the probability score. To evaluate the proposed method, we implement it on Office video dataset that contains videos with camera movement/shaking and illumination changes. Experimental results show the superior performance compared to the single view results of the state-of-the-art GMM based method.
| Original language | English |
|---|---|
| Title of host publication | 2017 IEEE international conference on multimedia & expo workshops (ICMEW) |
| Place of Publication | United States |
| Publisher | IEEE, Institute of Electrical and Electronics Engineers |
| Pages | 692-697 |
| Number of pages | 6 |
| ISBN (Electronic) | 9781538605608 |
| ISBN (Print) | 9781538605615 (Print on demand) |
| DOIs | |
| Publication status | Published - 07 Sept 2017 |
| Event | IEEE International Conference on Multimedia and Expo (ICME) 2017 - Harbour Grand Kowloon, Hong Kong, Hong Kong Duration: 10 Jul 2017 → 14 Jul 2017 http://www.icme2017.org/ (Conference website) http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=8014303 (Conference proceedings (ICME 2017)) http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=8014334 (Conference proceedings (ICMEW 2017)) |
Conference
| Conference | IEEE International Conference on Multimedia and Expo (ICME) 2017 |
|---|---|
| Abbreviated title | The New Media Experience |
| Country/Territory | Hong Kong |
| City | Hong Kong |
| Period | 10/07/17 → 14/07/17 |
| Other | The IEEE International Conference on Multimedia & Expo (ICME) has been the flagship multimedia conference sponsored by four IEEE societies since 2000. It serves as a forum to promote the exchange of the latest advances in multimedia technologies, systems, and applications from both the research and development perspectives of the circuits and systems, communications, computer, and signal processing communities. ICME also features an Exposition of multimedia products and prototypes. ICME 2017 is the 18th ICME conference. The main theme of 2017 is "The New Media Experience", enabling next generation 3D/AR/VR experiences and applications, based on which various sessions and events, in particular a Grand Challenge, will be organized. About 400 participants mainly from Asia, Europe and North America will gather in Hong Kong to discuss and progress latest development in multimedia technologies and related fields. This year, the best contributions to the conference will be honoured with the 10k Best Paper Award which promotes research advances in the general Multimedia related areas: Text, Graphics, Vision, Image, Video, Audio, Speech, Sensing data, and their mining, learning, processing, compression, communications, rendering, and associated innovations and applications. |
| Internet address |
|