NormNet: Normalize Noun Phrases for More Robust NLP

Minlong Peng, Mingming Sun


Abstract
A critical limitation of deep NLP models is their over-fitting over spurious features. Previous work has proposed several approaches to debunk such features and reduce their impact on the learned models. In this work, a normalization strategy is proposed to eliminate the false features caused by the textual surfaces of noun phrases. The motivation for this strategy is that noun phrases often play the role of slots in textual expressions and their exact forms are often not that important for performing the final task. As an intuitive example, consider the expression ”x like eating y". There are a huge number of suitable instantiations for x and y in the locale. However, humans can already infer the sentiment polarity of x toward y without knowing their exact forms.Based on this intuition, we introduce NormNet, a pretrained language model based network, to implement the normalization strategy. NormNet learns to replace as many noun phrases in the input sentence as possible with pre-defined base forms. The output of NormNet is then fed as input to a prompt-based learning model to perform label prediction. To evaluate the effectiveness of our strategy, we conducted experimental studies on several tasks, including aspect sentiment classification (ASC), semantic text similarity (STS), and natural language inference (NLI). The experimental results confirm the effectiveness of our strategy.
Anthology ID:
2023.findings-acl.136
Volume:
Findings of the Association for Computational Linguistics: ACL 2023
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2171–2183
Language:
URL:
https://aclanthology.org/2023.findings-acl.136
DOI:
10.18653/v1/2023.findings-acl.136
Bibkey:
Cite (ACL):
Minlong Peng and Mingming Sun. 2023. NormNet: Normalize Noun Phrases for More Robust NLP. In Findings of the Association for Computational Linguistics: ACL 2023, pages 2171–2183, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
NormNet: Normalize Noun Phrases for More Robust NLP (Peng & Sun, Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-acl.136.pdf