Brief review of facial expression recognition techniques

Khan, Sajid Ali; Shabbir, Sohaib; Akram, Rabia; Altaf, Nouman; Ghafoor, M. Owais; Shaheen, Muhammad

International Journal of Advanced and Applied Sciences

Int. j. adv. appl. sci.

EISSN: 2313-3724

Print ISSN: 2313-626X

Volume 4, Issue 4 (April 2017), Pages: 27-32

Title: Brief review of facial expression recognition techniques

Author(s): Sajid Ali Khan ^1, *, Sohaib Shabbir ², Rabia Akram², Nouman Altaf ², M. Owais Ghafoor ², Muhammad Shaheen ²

Affiliation(s):

¹Department of Computer Science, Shaheed Zulfikar Ali Bhutto Institute of Science and Technology, Islamabad, Pakistan
²Department of Software Engineering, Foundation University Islamabad, Islamabad, Pakistan

https://doi.org/10.21833/ijaas.2017.04.005

Full Text - PDF XML

Abstract:

In this era of technology, we need applications which could be easy to use and are user-friendly that even people with certain disabilities could use them easily. Many applications exist for human behavior understanding, detection of mental disorders, and synthetic human expressions in the domain of automatic facial recognition systems. Generally, most of the publications propose two methods for automatic Facial Expression Recognition (FER) systems i.e. geometric based and appearance based approach. Much work has been done on the static analysis where facial expression recognition had been performed on still images. While facial expressions are naturally dynamic, they are not easy to detect so the focus of the study is now shifted to find new methods which would be helpful to improve accuracy, lower computational cost, and less memory consumption. This paper demonstrates a quick survey of facial expression recognition by analyzing various algorithms; evaluated by comparing their results in general which in turn broadened the scope for other researchers they could efficiently offer a solution to related problems.

This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

Keywords: Facial expression recognition, Feature extraction, Classification, Survey

Article History: Received 22 December 2016, Received in revised form 5 March 2017, Accepted 5 March 2017

Digital Object Identifier:

https://doi.org/10.21833/ijaas.2017.04.005

Citation:

Khan SA, Shabbir S, Akram R, Altaf N, Ghafoor MO, and Shaheen M (2017). Brief review of facial expression recognition techniques. International Journal of Advanced and Applied Sciences, 4(4): 27-32

http://www.science-gate.com/IJAAS/V4I4/Khan.html

References:

Altman NS (1992). An introduction to kernel and nearest-neighbor nonparametric regression. The American Statistician, 46(3): 175-185. https://doi.org/10.1080/00031305.1992.10475879

Bartlett MS, Movellan JR, and Sejnowski TJ (2002). Face recognition by independent component analysis. IEEE Transactions on Neural Networks, 13(6): 1450-1464. https://doi.org/10.1109/TNN.2002.804287 PMid:18244540 PMCid:PMC2898524

Belhumeur PN, Hespanha JP, and Kriegman DJ (1997). Eigen faces vs. fisher faces: Recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7): 711-720. https://doi.org/10.1109/34.598228

Butalia MA, Ingle M, and Kulkarni P (2012). Facial expression recognition for security. International Journal of Modern Engineering Research (IJMER), 2(4): 1449-1453.

Carcagnì P, Del Coco M, Leo M, and Distante C (2015). Facial expression recognition and histograms of oriented gradients: a comprehensive study. Springer Plus, 4(1): 645. https://doi.org/10.1186/s40064-015-1427-3

Chin S and Kim KY (2009). Emotional intensity-based facial expression cloning for low polygonal applications. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 39(3): 315-330. https://doi.org/10.1109/TSMCC.2008.2011283

Darwin C, Ekman P, and Prodger P (1998). The expression of the emotions in man and animals. Oxford University Press, Oxford, UK. PMCid:PMC107417

Dornaika F, Moujahid A, and Raducanu B (2013). Facial expression recognition using tracked facial actions: Classifier performance analysis. Engineering Applications of Artificial Intelligence, 26(1): 467-477. https://doi.org/10.1016/j.engappai.2012.09.002

Dureha A (2014). An accurate algorithm for generating a music playlist based on facial expressions. International Journal of Computer Applications, 100(9): 33-39. https://doi.org/10.5120/17557-8163

Ekman P and Friesen WV (1971). Constants across cultures in the face and emotion. Journal of Personality and Social Psychology, 17(2): 124-129. https://doi.org/10.1037/h0030377 PMid:5542557

Ekman P and Friesen WV (2003). Unmasking the face: A guide to recognizing emotions from facial clues. Institute for the Study of Human Knowledge (ISHK), California, USA.

Fasel B and Luettin J (2003). Automatic facial expression analysis: a survey. Pattern Recognition, 36(1): 259-275. https://doi.org/10.1016/S0031-3203(02)00052-3

Hsieh CK, Lai SH, and Chen YC (2010). An optical flow-based approach to robust face recognition under expression variations. IEEE Transactions on Image Processing, 19(1): 233-240. https://doi.org/10.1109/TIP.2009.2031233 PMid:19717361

Hsu CW, Chang CC, and Lin CJ (2003). A practical guide to support vector classification. Technical Report, Department of Computer Science, National Taiwan University, Taipei City, Taiwan.

Imran SM, Rahman SM, and Hatzinakos D (2016). Differential components of discriminative 2D Gaussian–Hermite moments for recognition of facial expressions. Pattern Recognition, 56: 100-115. https://doi.org/10.1016/j.patcog.2016.03.006

Jabid T, Kabir MH, and Chae O (2010). Facial expression recognition using local directional pattern (LDP). In the 17th IEEE International Conference on Image Processing (ICIP), IEEE, Hong Kong, China: 1605-1608. https://doi.org/10.1109/icip.2010.5652374

Kamarol SKA, Jaward MH, Parkkinen J, and Parthiban R (2016). Spatiotemporal feature extraction for facial expression recognition. IET Image Processing, 10(7): 534-541. https://doi.org/10.1049/iet-ipr.2015.0519

Kazemi V and Sullivan J (2014). One millisecond face alignment with an ensemble of regression trees. In the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, Columbus, USA: 1867-1874. https://doi.org/10.1109/cvpr.2014.241

Khan RA, Meyer A, Konik H, and Bouakaz S (2013). Framework for reliable, real-time facial expression recognition for low resolution images. Pattern Recognition Letters, 34(10): 1159-1168. https://doi.org/10.1016/j.patrec.2013.03.022

Mandal MK, Pandey R, and Prasad AB (1998). Facial expressions of emotions and schizophrenia: A review. Schizophrenia Bulletin, 24(3): 399-412. https://doi.org/10.1093/oxfordjournals.schbul.a033335 PMid:9718632

Mehrabian A (1968). Some referents and measures of nonverbal behavior. Behavior Research Methods and Instrumentation, 1(6): 203-207. https://doi.org/10.3758/BF03208096

Mistry K, Zhang L, Neoh SC, Lim CP, and Fielding B (2016). A micro-GA embedded PSO feature selection approach to intelligent facial emotion recognition. IEEE Transactions on Cybernetics, PP(99):1-14. https://doi.org/10.1109/TCYB.2016.2549639

Ojala T, Pietikäinen M, and Harwood D (1996). A comparative study of texture measures with classification based on featured distributions. Pattern Recognition, 29(1): 51-59. https://doi.org/10.1016/0031-3203(95)00067-4

Patil HY, Kothari AG, and Bhurchandi KM (2016). Expression invariant face recognition using local binary patterns and contourlet transform. Optik-International Journal for Light and Electron Optics, 127(5): 2670-2678. https://doi.org/10.1016/j.ijleo.2015.11.187

Pu X, Fan K, Chen X, Ji L, and Zhou Z (2015). Facial expression recognition from image sequences using twofold random forest classifier. Neurocomputing, 168: 1173-1180. https://doi.org/10.1016/j.neucom.2015.05.005

Radlak K and Smolka B (2016). High dimensional local binary patterns for facial expression recognition in the wild. In the 18th Mediterranean Electrotechnical Conference (MELECON), IEEE, Limassol, Cyprus: 1-5. https://doi.org/10.1109/melcon.2016.7495381

Tong Y, Chen R, and Cheng Y (2014). Facial expression recognition algorithm using LGC based on horizontal and diagonal prior principle. Optik-International Journal for Light and Electron Optics, 125(16): 4186-4189. https://doi.org/10.1016/j.ijleo.2014.04.062

Turk MA and Pentland AP (1991). Face recognition using Eigen faces. In the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '91), IEEE, Maui, USA: 586-591. https://doi.org/10.1109/CVPR.1991.139758

Wu Y, Liu W, and Wang J (2008). Application of emotional recognition in intelligent tutoring system. In the First International Workshop on Knowledge Discovery and Data Mining, WKDD 2008, IEEE, Adelaide, Australia: 449-452. https://doi.org/10.1109/wkdd.2008.141

Yu K, Wang Z, Zhuo L, Wang J, Chi Z, and Feng D (2013). Learning realistic facial expressions from web images. Pattern Recognition, 46(8): 2144-2155. https://doi.org/10.1016/j.patcog.2013.01.032

Zhang Z and Zhang J (2006). A new real-time eye tracking for driver fatigue detection. In the 6th International Conference on ITS Telecommunications Proceedings, IEEE, Chengdu, China: 8-11. https://doi.org/10.1109/itst.2006.288748

Zhu X and Ramanan D (2012). Face detection, pose estimation, and landmark localization in the wild. In the IEEE Conference on Computer Vision and Pattern Recognition, IEEE: 2879-2886. https://doi.org/10.1109/CVPR.2012.6248014