Can Word Sense Distribution Detect Semantic Changes of Words?

Xiaohang Tang, Yi Zhou, Taichi Aida, Procheta Sen, Danushka Bollegala


Abstract
Semantic Change Detection of words is an important task for various NLP applications that must make time-sensitive predictions. Some words are used over time in novel ways to express new meanings, and these new meanings establish themselves as novel senses of existing words. On the other hand, Word Sense Disambiguation (WSD) methods associate ambiguous words with sense ids, depending on the context in which they occur. Given this relationship between WSD and SCD, we explore the possibility of predicting whether a target word has its meaning changed between two corpora collected at different time steps, by comparing the distributions of senses of that word in each corpora. For this purpose, we use pretrained static sense embeddings to automatically annotate each occurrence of the target word in a corpus with a sense id. Next, we compute the distribution of sense ids of a target word in a given corpus. Finally, we use different divergence or distance measures to quantify the semantic change of the target word across the two given corpora. Our experimental results on SemEval 2020 Task 1 dataset show that word sense distributions can be accurately used to predict semantic changes of words in English, German, Swedish and Latin.
Anthology ID:
2023.findings-emnlp.231
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2023
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3575–3590
Language:
URL:
https://aclanthology.org/2023.findings-emnlp.231
DOI:
10.18653/v1/2023.findings-emnlp.231
Bibkey:
Cite (ACL):
Xiaohang Tang, Yi Zhou, Taichi Aida, Procheta Sen, and Danushka Bollegala. 2023. Can Word Sense Distribution Detect Semantic Changes of Words?. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 3575–3590, Singapore. Association for Computational Linguistics.
Cite (Informal):
Can Word Sense Distribution Detect Semantic Changes of Words? (Tang et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-emnlp.231.pdf