Human Behavioral Analysis Based in Facial Emotion and Gesture (Survey)
Raghad Ghalib Abd, Ameen A. Noor, Abdul-Wahab Sami Ibrahim
International Journal of Computational and Electronic Aspects in Engineering
Volume 3: Issue 3, September 2022, pp 47-54
Author's Information
Raghad Ghalib Abd1
Corresponding Author
1Computer Science Department, College of Education, University of Almustansirya Baghdad, Iraq.
Raghadghalib@uomustansiriyah.edu.iq
Ameen A. Noor2
2Computer Science Department, College of Education, University of Almustansirya Baghdad, Iraq.
Abdul-Wahab Sami Ibrahim3
3Computer Science Department, College of Education, University of Almustansirya Baghdad, Iraq
Abstract:-
This survey paper describes a number of fields in which human behavior analysis through facial gestures is applied, the various method that is utilized with the most recent technologies. Cutting-edge camera technology was used to capture images and assess a person's emotions. Human behavior is studied through facial and body gestures, and in this study, we divide human emotions into universally acknowledged expressions such as "sad," "happy," "surprised," "worried," and "liar." The limitations and benefits of competing and complementary technologies are discussed in this study, as well as the diversity of research in the area of human behavioral analysis based on face and gestures.Index Terms:-
Facial recognize, Human behavioral analysis, Human face and gesture analysis, Human facial recognition, Gesture analysisREFERENCES
- Mehrabian, A. Communication without words. Psychol. Today 2, 53–56 (1968).
Crossref - Bhattacharyya, A., Chatterjee, S., Sen, S., Sinitca, A., Kaplun, D., & Sarkar, R. (2021). A deep learning model for classifying human facial expressions from infrared thermal images. Scientific Reports, 11(1).
Crossref - Ekman, P. & Friesen, W. V. Facial Action Coding System (Consulting Psychology Press, 1978)
- Kopaczka, M., Kolk, R. & Merhof, D. A fully annotated thermal face database and its application for thermal facial expression recognition. In IEEE International Instrumentation and Measurement Technology Conference (I2MTC) 1–6 (2018).
Crossref - Zafeiriou S, Kollias D, Nicolaou MA, Papaioannou A, Zhao G, Kotsia I (2017) Aff-wild: valence and arousal in-the-wild challenge. In: IEEE CVPR workshop.
Online - Khan, G., Samyan, S., Khan, M. U. G., Shahid, M., & Wahla, S. Q. (2020). A survey on analysis of human faces and facial expressions datasets. International Journal of Machine Learning and Cybernetics, 11(3), 553–571.
Crossref - Sajjad, M., Zahir, S., Ullah, A., Akhtar, Z., & Muhammad, K. (2020). Human Behavior Understanding in Big Multimedia Data Using CNN based Facial Expression Recognition. Mobile Networks and Applications, 25(4), 1611–1621.
Crossref - Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: international Conference on computer vision & Pattern Recognition (CVPR'05). IEEE Computer Society.
Crossref - Shokrani S, Moallem P, Habibi M (2014) Facial emotion recognition method based on Pyramid Histogram of Oriented Gradient over three direction of head. In: Computer and Knowledge Engineering (ICCKE), 2014 4th International eConference on. IEEE.
Crossref - S. A. Sirohey. Human face segmentation and identification. Technical Report CS-TR-3176, University of Maryland, 1993.
Online - D. Chetverikov and A. Lerch. Multiresolution face detection. In Theoretical Foundations of Computer Vision, volume 69 of Mathematical Research, pages 131-140. Akademie Verlg, 1993.
- Yang, M.-H., & Ahuja, N. (2001). Face Detection and Gesture Recognition for Human-Computer Interaction (Vol. 1). Springer US.
Crossref - Yolcu, G., Oztel, I., Kazan, S., Oz, C., & Bunyak, F. (2020). Deep learning-based face analysis system for monitoring customer interest. Journal of Ambient Intelligence and Humanized Computing, 11(1).
Crossref - Hammal, Z., Huang, D., Bailly, K., Chen, L., & Daoudi, M. (2020). Face and Gesture Analysis for Health Informatics. ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction, 874–875.
Crossref - Kowallik, A. E., Pohl, M., & Schweinberger, S. R. (2021). Facial imitation improves emotion recognition in adults with different levels of sub-clinical autistic traits. Journal of Intelligence, 9(1), 1–14.
Crossref - Ho An, K., Jin Chung, M., & Member, S. (2009). Cognitive Face Analysis System for Future Interactive TV.
- Correa, M., Ruiz-Del-Solar, J., & Verschae, R. (2016). A realistic virtual environment for evaluating face analysis systems under dynamic conditions. Pattern Recognition, 52, 160–173.
Crossref - J. Ruiz-del-Solar, R. Verschae, M. Correa, Recognition of faces in unconstrained environments: a comparative study, EURASIP J. Adv. Signal Process. (2009) 19184617 (Recent Advances in Biometric Systems: A Signal Processing Perspective).
Crossref - Samal, A., & Iylngar, P. A. (1992). automatic recognition and analysis of human faces and facial expressions: a survey (Vol. 25, Issue 1).
Crossref - MichałBeretaabPawełKarczmarekacWitoldPedryczadMarekReformata, “Local descriptors in application to the aging problem in face recognition”, Pattern Recognition, Volume 46, Issue 10, October 2013, Pages 2634-2646.
Crossref - Face Recognition Home Page (Available on June 4th, 2012).
Online - R. Gross, Face databases, in: S. Li, A.K. Jain (Eds.), Handbook of Face Recognition, Springer-Verlag, 2005, pp. 301–327.
- G.B. Huang, M. Ramesh, T. Berg, E. Learned-Miller, Labeled faces in the wild: a database for studying face recognition in unconstrained environments (Technical Report 07-49), University of Massachusetts, Amherst, 2007.
Crossref - S. Zafeiriou, M. Hansen, G. Atkinson, V. Argyriou, M. Petrou, M. Smith, L. Smith, The photoface database, in: Proceedings of Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2011, pp. 132–139.
Crossref - G. Hermosilla, J. Ruiz-del-Solar, R. Verschae, M. Correa, A comparative study of thermal face recognition methods in unconstrained environments, Pattern Recognit. 45 (7) (2012) 2445–2459.
Crossref - R.S. Ghiass, O. Arandjelović, A. Bendada, X. Maldague, Infrared face recognition: a comprehensive review of methodologies and databases, Pattern Recognit. 47 (9) (2014) 2807–2824.
Crossref - Ezhil, A. J., & Adalarasu, K. (2013). FPGA Implementation of Human Behavior Analysis Using Facial Image. In International Journal of Engineering Trends and Applications (IJETA) (Vol. 2).
Online - Gunes, H., & Piccardi, M. (2007). Bi-modal emotion recognition from expressive face and body gestures. Journal of Network and Computer Applications, 30(4), 1334–1345.
Crossref
To view full paper, Download here