A Prototypical Semantic Decoupling Method via Joint Contrastive Learning for Few-Shot Named Entity Recognition

Abstract

Few-shot named entity recognition (NER) aims at identifying named entities based on only few labeled instances. Most existing prototype-based sequence labeling models tend to memorize entity mentions which would be easily confused by close prototypes. In this paper, we proposed a Prototypical Semantic Decoupling method via joint Contrastive learning (PSDC) for few-shot NER. Specifically, we decouple class-specific prototypes and contextual semantic prototypes by two masking strategies to lead the model to focus on two different semantic information for inference. Besides, we further introduce joint contrastive learning objectives to better integrate two kinds of decoupling information and prevent semantic collapse. Experimental results on two few-shot NER benchmarks demonstrate that PSDC consistently outperforms the previous SOTA methods in terms of overall performance. Extensive analysis further validates the effectiveness and generalization of PSDC.

Publication
ICASSP 2023
Guanting Dong
Guanting Dong
Postgraduate Student

Spoken Language Understading and related applications

Zechen Wang
Zechen Wang
Postgraduate Student
Liwen Wang
Liwen Wang
Postgraduate Student

Spoken Language Understading and related applications

Daichi Guo
Daichi Guo
Postgraduate Student

Debiaes, Class Imbalance

Dayuan Fu
Dayuan Fu
Postgraduate Student
Chen Zeng
Chen Zeng
Postgraduate Student
Xuefeng Li
Xuefeng Li
Postgraduate Student

Slot Filling, Intent Detection

Tingfeng Hui
Tingfeng Hui
Postgraduate Student
Keqing He
Postgraduate Student

Dialogue System, Summarization, Pre-training Language Model

Qixiang Gao
Qixiang Gao
Postgraduate Student

Task-oriented Dialogue System, Dialogue State Tracking

Weiran Xu
Weiran Xu
Associate Professor, Master Supervisor, Ph.D Supervisor

Information Retrieval, Pattern Recognition, Machine Learning