Connective Prediction for Implicit Discourse Relation Recognition via Knowledge Distillation

Hongyi Wu, Hao Zhou, Man Lan, Yuanbin Wu, Yadong Zhang


Abstract
Implicit discourse relation recognition (IDRR) remains a challenging task in discourse analysis due to the absence of connectives. Most existing methods utilize one-hot labels as the sole optimization target, ignoring the internal association among connectives. Besides, these approaches spend lots of effort on template construction, negatively affecting the generalization capability. To address these problems,we propose a novel Connective Prediction via Knowledge Distillation (CP-KD) approach to instruct large-scale pre-trained language models (PLMs) mining the latent correlations between connectives and discourse relations, which is meaningful for IDRR. Experimental results on the PDTB 2.0/3.0 and CoNLL2016 datasets show that our method significantly outperforms the state-of-the-art models on coarse-grained and fine-grained discourse relations. Moreover, our approach can be transferred to explicit discourse relation recognition(EDRR) and achieve acceptable performance.
Anthology ID:
2023.acl-long.325
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5908–5923
Language:
URL:
https://aclanthology.org/2023.acl-long.325
DOI:
10.18653/v1/2023.acl-long.325
Bibkey:
Cite (ACL):
Hongyi Wu, Hao Zhou, Man Lan, Yuanbin Wu, and Yadong Zhang. 2023. Connective Prediction for Implicit Discourse Relation Recognition via Knowledge Distillation. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 5908–5923, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Connective Prediction for Implicit Discourse Relation Recognition via Knowledge Distillation (Wu et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.325.pdf
Video:
 https://aclanthology.org/2023.acl-long.325.mp4