TY - JOUR
T1 - A novel deep learning system for facial feature extraction by fusing CNN and MB-LBP and using enhanced loss function
AU - Silwal, Raj
AU - Alsadoon, Abeer
AU - Prasad, P. W.C.
AU - Hisham Alsadoon, Omar
AU - Al-Qaraghuli, Ammar
N1 - Includes bibliographical references
PY - 2020/11
Y1 - 2020/11
N2 - Extensive use of surveillance cameras for human tracking and observation have been fostering the research on face recognition technique for individual identification in an unconstrained environment. However, face recognition is a challenging task in an unconstrained environment, where the captured images are affected by illumination effect, varying poses, noise and occlusion. The main objective of this research is to improve the accuracy and processing time in extracting facial features by using the fusion of deep learning and handcrafted architecture for recognizing individuals in unconstrained conditions, thereby providing accurate information about the individuals to security systems. The proposed system consists of Multi-Block Local Binary Pattern (MB-LBP) modules for extracting the handcrafted features and Convolutional Neural Network (CNN) for extracting the high-level distinctive features. The features from both modules are fused and passed through fully connected layer with Softmax classifier to identify individuals. The results show that the enhanced algorithm based on Softmax loss function aided classifier with regularization improves the accuracy and processing time for face recognition. The proposed model improves accuracy by 94.37% against 90.01% for the state-of-the-art solution. In addition to that, it improves the processing time of 307 ms against 357 ms. The proposed system focuses on fusing hand-crafted and deep learned features to extract face features accurately and thus improving the accuracy and overall performance of the proposed system in an unconstrained environment.
AB - Extensive use of surveillance cameras for human tracking and observation have been fostering the research on face recognition technique for individual identification in an unconstrained environment. However, face recognition is a challenging task in an unconstrained environment, where the captured images are affected by illumination effect, varying poses, noise and occlusion. The main objective of this research is to improve the accuracy and processing time in extracting facial features by using the fusion of deep learning and handcrafted architecture for recognizing individuals in unconstrained conditions, thereby providing accurate information about the individuals to security systems. The proposed system consists of Multi-Block Local Binary Pattern (MB-LBP) modules for extracting the handcrafted features and Convolutional Neural Network (CNN) for extracting the high-level distinctive features. The features from both modules are fused and passed through fully connected layer with Softmax classifier to identify individuals. The results show that the enhanced algorithm based on Softmax loss function aided classifier with regularization improves the accuracy and processing time for face recognition. The proposed model improves accuracy by 94.37% against 90.01% for the state-of-the-art solution. In addition to that, it improves the processing time of 307 ms against 357 ms. The proposed system focuses on fusing hand-crafted and deep learned features to extract face features accurately and thus improving the accuracy and overall performance of the proposed system in an unconstrained environment.
KW - Convolutional neural network
KW - Deep learning
KW - Facial image recognition
KW - Multi-block local binary pattern
UR - http://www.scopus.com/inward/record.url?scp=85089513680&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85089513680&partnerID=8YFLogxK
U2 - 10.1007/s11042-020-09559-1
DO - 10.1007/s11042-020-09559-1
M3 - Article
AN - SCOPUS:85089513680
SN - 1380-7501
VL - 79
SP - 31027
EP - 31047
JO - Multimedia Tools and Applications
JF - Multimedia Tools and Applications
ER -