Human Behavioral Analysis Based in Facial Emotion and Gesture (Survey)

Raghad Ghalib Abd, Ameen A. Noor, Abdul-Wahab Sami Ibrahim
International Journal of Computational and Electronic Aspects in Engineering
Volume 3: Issue 3, September 2022, pp 47-54


Author's Information
Raghad Ghalib Abd1 
Corresponding Author
1Computer Science Department, College of Education, University of Almustansirya Baghdad, Iraq.
Raghadghalib@uomustansiriyah.edu.iq

Ameen A. Noor2
2Computer Science Department, College of Education, University of Almustansirya Baghdad, Iraq.

Abdul-Wahab Sami Ibrahim3
3Computer Science Department, College of Education, University of Almustansirya Baghdad, Iraq

Technical Article -- Peer Reviewed
First online on – 05 September 2022

Open Access article under Creative Commons License

Cite this article –Raghad Ghalib Abd, Ameen A. Noor, Abdul-Wahab Sami Ibrahim “Human Behavioral Analysis Based in Facial Emotion and Gesture (Survey)”, International Journal of Computational and Electronic Aspects in Engineering, RAME Publishers, vol. 3, Issue 3, pp. 47-54, 2022.
https://doi.org/10.26706/ijceae.3.3.2210551


Abstract:-
This survey paper describes a number of fields in which human behavior analysis through facial gestures is applied, the various method that is utilized with the most recent technologies. Cutting-edge camera technology was used to capture images and assess a person's emotions. Human behavior is studied through facial and body gestures, and in this study, we divide human emotions into universally acknowledged expressions such as "sad," "happy," "surprised," "worried," and "liar." The limitations and benefits of competing and complementary technologies are discussed in this study, as well as the diversity of research in the area of human behavioral analysis based on face and gestures.
Index Terms:-
Facial recognize, Human behavioral analysis, Human face and gesture analysis, Human facial recognition, Gesture analysis
REFERENCES
  1. Mehrabian, A. Communication without words. Psychol. Today 2, 53–56 (1968).
    Crossref

  2. Bhattacharyya, A., Chatterjee, S., Sen, S., Sinitca, A., Kaplun, D., & Sarkar, R. (2021). A deep learning model for classifying human facial expressions from infrared thermal images. Scientific Reports, 11(1).
    Crossref

  3. Ekman, P. & Friesen, W. V. Facial Action Coding System (Consulting Psychology Press, 1978)

  4. Kopaczka, M., Kolk, R. & Merhof, D. A fully annotated thermal face database and its application for thermal facial expression recognition. In IEEE International Instrumentation and Measurement Technology Conference (I2MTC) 1–6 (2018).
    Crossref

  5. Zafeiriou S, Kollias D, Nicolaou MA, Papaioannou A, Zhao G, Kotsia I (2017) Aff-wild: valence and arousal in-the-wild challenge. In: IEEE CVPR workshop.
    Online

  6. Khan, G., Samyan, S., Khan, M. U. G., Shahid, M., & Wahla, S. Q. (2020). A survey on analysis of human faces and facial expressions datasets. International Journal of Machine Learning and Cybernetics, 11(3), 553–571.
    Crossref

  7. Sajjad, M., Zahir, S., Ullah, A., Akhtar, Z., & Muhammad, K. (2020). Human Behavior Understanding in Big Multimedia Data Using CNN based Facial Expression Recognition. Mobile Networks and Applications, 25(4), 1611–1621.
    Crossref

  8. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: international Conference on computer vision & Pattern Recognition (CVPR'05). IEEE Computer Society.
    Crossref

  9. Shokrani S, Moallem P, Habibi M (2014) Facial emotion recognition method based on Pyramid Histogram of Oriented Gradient over three direction of head. In: Computer and Knowledge Engineering (ICCKE), 2014 4th International eConference on. IEEE.
    Crossref

  10. S. A. Sirohey. Human face segmentation and identification. Technical Report CS-TR-3176, University of Maryland, 1993.
    Online

  11. D. Chetverikov and A. Lerch. Multiresolution face detection. In Theoretical Foundations of Computer Vision, volume 69 of Mathematical Research, pages 131-140. Akademie Verlg, 1993.

  12. Yang, M.-H., & Ahuja, N. (2001). Face Detection and Gesture Recognition for Human-Computer Interaction (Vol. 1). Springer US.
    Crossref

  13. Yolcu, G., Oztel, I., Kazan, S., Oz, C., & Bunyak, F. (2020). Deep learning-based face analysis system for monitoring customer interest. Journal of Ambient Intelligence and Humanized Computing, 11(1).
    Crossref

  14. Hammal, Z., Huang, D., Bailly, K., Chen, L., & Daoudi, M. (2020). Face and Gesture Analysis for Health Informatics. ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction, 874–875.
    Crossref

  15. Kowallik, A. E., Pohl, M., & Schweinberger, S. R. (2021). Facial imitation improves emotion recognition in adults with different levels of sub-clinical autistic traits. Journal of Intelligence, 9(1), 1–14.
    Crossref

  16. Ho An, K., Jin Chung, M., & Member, S. (2009). Cognitive Face Analysis System for Future Interactive TV.

  17. Correa, M., Ruiz-Del-Solar, J., & Verschae, R. (2016). A realistic virtual environment for evaluating face analysis systems under dynamic conditions. Pattern Recognition, 52, 160–173.
    Crossref

  18. J. Ruiz-del-Solar, R. Verschae, M. Correa, Recognition of faces in unconstrained environments: a comparative study, EURASIP J. Adv. Signal Process. (2009) 19184617 (Recent Advances in Biometric Systems: A Signal Processing Perspective).
    Crossref

  19. Samal, A., & Iylngar, P. A. (1992). automatic recognition and analysis of human faces and facial expressions: a survey (Vol. 25, Issue 1).
    Crossref

  20. MichałBeretaabPawełKarczmarekacWitoldPedryczadMarekReformata, “Local descriptors in application to the aging problem in face recognition”, Pattern Recognition, Volume 46, Issue 10, October 2013, Pages 2634-2646.
    Crossref

  21. Face Recognition Home Page (Available on June 4th, 2012).
    Online

  22. R. Gross, Face databases, in: S. Li, A.K. Jain (Eds.), Handbook of Face Recognition, Springer-Verlag, 2005, pp. 301–327.

  23. G.B. Huang, M. Ramesh, T. Berg, E. Learned-Miller, Labeled faces in the wild: a database for studying face recognition in unconstrained environments (Technical Report 07-49), University of Massachusetts, Amherst, 2007.
    Crossref

  24. S. Zafeiriou, M. Hansen, G. Atkinson, V. Argyriou, M. Petrou, M. Smith, L. Smith, The photoface database, in: Proceedings of Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2011, pp. 132–139.
    Crossref

  25. G. Hermosilla, J. Ruiz-del-Solar, R. Verschae, M. Correa, A comparative study of thermal face recognition methods in unconstrained environments, Pattern Recognit. 45 (7) (2012) 2445–2459.
    Crossref

  26. R.S. Ghiass, O. Arandjelović, A. Bendada, X. Maldague, Infrared face recognition: a comprehensive review of methodologies and databases, Pattern Recognit. 47 (9) (2014) 2807–2824.
    Crossref

  27. Ezhil, A. J., & Adalarasu, K. (2013). FPGA Implementation of Human Behavior Analysis Using Facial Image. In International Journal of Engineering Trends and Applications (IJETA) (Vol. 2).
    Online

  28. Gunes, H., & Piccardi, M. (2007). Bi-modal emotion recognition from expressive face and body gestures. Journal of Network and Computer Applications, 30(4), 1334–1345.
    Crossref

  29. To view full paper, Download here


Publishing with