4 October 2024 ASDC-FER: attention-guided self-supervised distilled contrastive learning for facial expression recognition
Lingyu Yan, Jinquan Yang, Chunzhi Wang
Author Affiliations +
Abstract

Facial expression recognition (FER) is crucial for understanding and assessing human emotional states. However, in practical applications, due to the complexity and diversity of facial expressions, traditional self-supervised contrastive learning methods are often difficult to extract fine-grained expression features. To address this problem, we propose an attention-guided self-supervised distilled contrastive learning method for FER, which transfers the expression differential information learned by the teacher network to the student network by introducing attention-guided knowledge distillation in self-supervised contrastive learning. Specifically, we propose attention-guided joint feature distillation to strengthen the feature representation capability of the student network by guiding the student network through feature learning with joint attention-weighted features and comparison query vectors. In addition, to further utilize the key information in the teacher’s features, the facial key feature guidance is also proposed to make the student more focused on learning the key features extracted from the teacher’s network. These advances lead to significant performance improvements, showcasing the robustness of our method. Our method obtains excellent results of 76.83% on the Real-world Affective Face Database and 62.04% on the FER-2013 datasets, respectively, demonstrating its effectiveness in capturing subtle emotional expressions and advancing the field of self-supervised FER.

© 2024 SPIE and IS&T
Lingyu Yan, Jinquan Yang, and Chunzhi Wang "ASDC-FER: attention-guided self-supervised distilled contrastive learning for facial expression recognition," Journal of Electronic Imaging 33(5), 053029 (4 October 2024). https://doi.org/10.1117/1.JEI.33.5.053029
Received: 13 May 2024; Accepted: 10 September 2024; Published: 4 October 2024
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Performance modeling

Feature extraction

Data modeling

Facial recognition systems

Convolution

Education and training

Visual process modeling

Back to Top