Facial expression recognition using hybrid features and self-organizing maps

Faisal Farooq, Jalal Ahmed, Lihong Zheng

Research output: Book chapter/Published conference paperConference paperpeer-review

45 Citations (Scopus)


This paper presents a new method to recognize human facial expression by feeding hybrid features to Self-organizing maps (SOM). Facial expression recognition is still a challenging problem that can be seen in many real applications such as security systems, behavioral science and clinical practices. In this work, we present a new way to analyze, represent and recognize human facial expressions from a video sequence. The proposed facial expression recognition framework comprises of following components: face detection, facial feature extraction and classification. Firstly, faces are detected based on skin color after removing background and noise effects from raw video sequences. Then each face image is aligned using vertex mask generation and the 1D transformation features are extracted to utilize the local information for each facial image. After reducing the dimension of features and doing independent component analysis, the new features are trained and tested using SOM. The experimental evaluation demonstrates the proposed approach over two public datasets such as Cohn-Kanade and AT&T datasets of facial expression videos achieves superior recognition performance of 96.81% and 96.55% over state of the art methods.
Original languageEnglish
Title of host publication2017 IEEE International Conference on Multimedia and Expo (ICME)
Place of PublicationUnited States
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages6
ISBN (Electronic)9781509060672
Publication statusPublished - 31 Aug 2017
EventIEEE International Conference on Multimedia and Expo (ICME) 2017 - Harbour Grand Kowloon, Hong Kong, Hong Kong
Duration: 10 Jul 201714 Jul 2017
http://www.icme2017.org/ (Conference website)
http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=8014303 (Conference proceedings (ICME 2017))
http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=8014334 (Conference proceedings (ICMEW 2017))


ConferenceIEEE International Conference on Multimedia and Expo (ICME) 2017
Abbreviated titleThe New Media Experience
Country/TerritoryHong Kong
CityHong Kong
OtherThe IEEE International Conference on Multimedia & Expo (ICME) has been the flagship multimedia conference sponsored by four IEEE societies since 2000. It serves as a forum to promote the exchange of the latest advances in multimedia technologies, systems, and applications from both the research and development perspectives of the circuits and systems, communications, computer, and signal processing communities. ICME also features an Exposition of multimedia products and prototypes. ICME 2017 is the 18th ICME conference. The main theme of 2017 is "The New Media Experience", enabling next generation 3D/AR/VR experiences and applications, based on which various sessions and events, in particular a Grand Challenge, will be organized. About 400 participants mainly from Asia, Europe and North America will gather in Hong Kong to discuss and progress latest development in multimedia technologies and related fields. This year, the best contributions to the conference will be honoured with the 10k Best Paper Award which promotes research advances in the general Multimedia related areas: Text, Graphics, Vision, Image, Video, Audio, Speech, Sensing data, and their mining, learning, processing, compression, communications, rendering, and associated innovations and applications.
Internet address


Dive into the research topics of 'Facial expression recognition using hybrid features and self-organizing maps'. Together they form a unique fingerprint.

Cite this