Research on multimodal online learning status evaluation based on video camera

Hui Xu; Xu Zhao; Yifan Wu; Huirong Wang

doi:10.1117/12.2667460

22 February 2023 Research on multimodal online learning status evaluation based on video camera

Hui Xu, Xu Zhao, Yifan Wu, Huirong Wang

Proceedings Volume 12587, Third International Seminar on Artificial Intelligence, Networking, and Information Technology (AINIT 2022); 125871U (2023) https://doi.org/10.1117/12.2667460
Event: Third International Seminar on Artificial Intelligence, Networking, and Information Technology (AINIT 2022), 2022, Shanghai, China

Abstract

A person's state is reflected in many aspects, such as emotions and body movements. Online teaching makes it difficult for teachers to accurately understand the learning status of students due to the separation of space between teachers and students. This paper extracts images from video cameras, from which identifies the learner's emotion, head posture and fatigue, and evaluates the learner's learning state by synthesizing the three-sided information. The seven emotions were divided into three categories: negative, positive and natural. Head posture is defined by Euler angles, and fatigue is determined by blinking frequency. Hierarchical decision-making method is used in the model for information fusion. The learning state assessment method proposed in this paper integrates the performance of both internal and external aspects of psychology and behavior, and has high reliability. Real-time understanding of students' learning status can help improve the effectiveness of teaching.

Citation Download Citation

Hui Xu, Xu Zhao, Yifan Wu, and Huirong Wang "Research on multimodal online learning status evaluation based on video camera", Proc. SPIE 12587, Third International Seminar on Artificial Intelligence, Networking, and Information Technology (AINIT 2022), 125871U (22 February 2023); https://doi.org/10.1117/12.2667460

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available