基于多掩码脑电信号的多任务跨受试者情绪识别

Multi-Task Cross-Subject Emotion Recognition Based on Multi-Mask Collaborative Learning of EEG

  • 摘要: 针对脑电情绪识别模型在跨受试者场景中面临的泛化难题,提出一种面向领域泛化的多掩码协同学习框架M2CER。传统方法因个体间脑电信号幅值波动大、时序模式差异显著,难以直接学习稳定的跨对象特征表示。基于此,设计了一种多掩码多任务学习模型:构建以掩码重构为核心的多任务协同学习机制,将掩码重构、掩码对比学习与域对抗训练统一整合。该机制通过重构任务恢复被遮蔽的信息,利用对比学习增强特征判别性,并通过域对抗训练显式缩小不同受试者间的特征分布差异。同时,在重构任务中引入跨域聚合机制,在潜在空间中对当前受试者的多重掩码序列与其他受试者样本进行相似性加权聚合,促使模型聚焦于不同受试者间共有且不变的本质特征。在公开数据集上的实验结果表明,该方法显著提升了模型在未见受试者数据上的识别性能与鲁棒性,为跨受试者情绪识别提供了一种无需目标域数据且具备强泛化能力的新思路。

     

    Abstract: To address the generalization challenges faced by Electroencephalogram(EEG)-based emotion recognition models in cross-subject scenarios, a domain generalization-oriented multi-mask collaborative learning framework: Multi-task Cross-subject Emotion Recognition based on Multi-masked EEG(M2CER) is proposed. Traditional methods often struggle to learn stable feature representations across individuals due to significant inter-subject variations in EEG signal amplitude and temporal patterns. This study designs a multi-mask multi-task learning model by constructing a multi-task collaborative learning mechanism centered on mask reconstruction, integrating mask reconstruction, masked contrastive learning, and domain adversarial training into a unified framework. This mechanism recovers masked information through reconstruction, enhances feature discriminability via contrastive learning, and explicitly reduces feature distribution discrepancies among subjects through domain adversarial training. Additionally, a cross-domain aggregation mechanism is integrated into the reconstruction process, performing similarity-weighted aggregation in the latent space between the current subject's multi-mask sequences and samples from other subjects, encouraging the model to focus on common and invariant essential features across subjects. Experiments on public datasets demonstrate that the proposed method effectively enhances the recognition performance and robustness on unseen subject data, offering a novel approach for cross-subject emotion recognition without requiring target domain data and exhibiting strong generalization capability.

     

/

返回文章
返回