A Robust Contrastive Alignment Method For Multi-Domain Text Classification

摘要

Multi-domain text classification can automatically classify texts in various scenarios. Due to the diversity of human languages, texts with the same label in different domains may differ greatly, which brings challenges to the multidomain text classification. Current advanced methods use the private-shared paradigm, capturing domain-shared features by a shared encoder, and training a private encoder for each domain to extract domain-specific features. However, in realistic scenarios, these methods suffer from inefficiency as new domains are constantly emerging. In this paper, we propose a robust contrastive alignment method to align text classification features of various domains in the same feature space by supervised contrastive learning. By this means, we only need two universal feature extractors to achieve multidomain text classification. Extensive experimental results show that our method performs on par with or sometimes better than the state-of-the-art method, which uses the complex multi-classifier in a private-shared framework

会议
ICASSP 2022
李雪峰
李雪峰
硕士研究生

填槽,意图识别

雷浩
雷浩
硕士研究生

机器阅读理解

王礼文
王礼文
硕士研究生

自然语言理解及相关应用

董冠霆
董冠霆
硕士研究生

自然语言理解

徐蔚然
徐蔚然
副教授,硕士生导师,博士生导师

信息检索,模式识别,机器学习