基于多尺度特征增强与全局-局部特征分析的微表情识别

Micro-Expression Recognition Based on Multi-Scale Feature Enhancement and Global-Local Feature Analysis

  • 摘要: 微表情识别在人类情绪分析领域具有重要意义。然而,由于微表情持续时间极短且难以察觉,其识别仍具有挑战性。为解决上述问题,提出了一种融合多尺度特征增强与全局-局部特征分析的微表情识别网络,旨在显著提升特征的表达能力。该网络由基于改进特征金字塔网络的多尺度特征增强模块以及全局-局部特征分析模块构成。针对微表情识别任务,对特征金字塔网络进行深度优化,通过融合注意力机制与双线性插值技术,充分利用层级化特征提取优势,有效解决了特征金字塔空间错位与特征丢失问题,从而显著提升了微表情识别的准确性。在CASME Ⅱ和SAMM数据集上的实验结果表明,相较于现有的前沿方法,该研究提出的方法在多项关键指标上取得了优异成果,在五分类任务中,在未加权平均召回率和未加权F1分数上取得最佳成绩。研究表明,该框架能有效应对微表情识别所面临的挑战。

     

    Abstract: Micro-expression recognition (MER) plays a crucial role in human emotion analysis. However, it remains challenging due to the transient and subtle nature of micro-expressions. To address these issues, a multi-scale feature micro-expression recognition network that integrates a multi-scale feature enhancement module based on an improved Feature Pyramid Network and a global-local feature analysis module is proposed to improve feature representation. The feature pyramid network is deeply optimized for the task of micro-expression recognition. By integrating attention mechanisms and bilinear interpolation, the approach effectively leverages hierarchical feature extraction capabilities to address the spatial misalignment and feature loss issues of feature pyramid network, thereby enhancing recognition performance. Experimental results on the CASME Ⅱ and SAMM datasets demonstrate that the method achieves competitive performance compared to state-of-the-art approaches, particularly excelling in certain key metrics. The approach excelled in the 5-class recognition task, achieving the best results in both unweighted average recall and unweighted F1-score. These findings highlight the effectiveness of the proposed framework in addressing the challenges of MER.

     

/

返回文章
返回