LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

Engagement Detection through Facial Emotional Recognition Using a Shallow Residual Convolutional Neural Networks

Photo from wikipedia

Online teaching and learning has recently turned out to be the order of the day, where majority of the learners undergo courses and trainings over the new environment. Learning through… Click to show full abstract

Online teaching and learning has recently turned out to be the order of the day, where majority of the learners undergo courses and trainings over the new environment. Learning through these platforms have created a requirement to understand if the learner is interested or not. Detecting engagement of the learners have sought increased attention to create learner centric models that can enhance the teaching and learning experience. The learner will over a period of time in the platform, tend to expose various emotions like engaged, bored, frustrated, confused, angry and other cues that can be classified as engaged or disengaged. This paper proposes in creating a Convolutional Neural Network (CNN) and enabling it with residual connections that can enhance the learning rate of the network and improve the classification on three Indian datasets that predominantly work on classroom engagement models. The proposed network performs well due to introduction of Residual learning that carries additional learning from the previous batch of layers into the next batch, Optimized Hyper Parametric (OHP) setting, increased dimensions of images for higher data abstraction and reduction of vanishing gradient problems resulting in managing overfitting issues. The Residual network introduced, consists of a shallow depth of 50 layers which has significantly produced an accuracy of 91.3% on ISED & iSAFE data while it achieves a 93.4% accuracy on the Daisee dataset. The average accuracy achieved by the classification network is 0.825 according to Cohens Kappa measure.

Keywords: emotional recognition; engagement detection; facial emotional; convolutional neural; network; detection facial

Journal Title: International Journal of Intelligent Engineering and Systems
Year Published: 2021

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.