Semantic Ambiguity Detection in Sentence Classification using Task-Specific Embeddings

Jong Myoung Kim, Young-jun Lee, Sangkeun Jung, Ho-jin Choi


Abstract
Ambiguity is a major obstacle to providing services based on sentence classification. However, because of the structural limitations of the service, there may not be sufficient contextual information to resolve the ambiguity. In this situation, we focus on ambiguity detection so that service design considering ambiguity is possible. We utilize similarity in a semantic space to detect ambiguity in service scenarios and training data. In addition, we apply task-specific embedding to improve performance. Our results demonstrate that ambiguities and resulting labeling errors in training data or scenarios can be detected. Additionally, we confirm that it can be used to debug services
Anthology ID:
2023.acl-industry.41
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 5: Industry Track)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Sunayana Sitaram, Beata Beigman Klebanov, Jason D Williams
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
425–437
Language:
URL:
https://aclanthology.org/2023.acl-industry.41
DOI:
10.18653/v1/2023.acl-industry.41
Bibkey:
Cite (ACL):
Jong Myoung Kim, Young-jun Lee, Sangkeun Jung, and Ho-jin Choi. 2023. Semantic Ambiguity Detection in Sentence Classification using Task-Specific Embeddings. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 5: Industry Track), pages 425–437, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Semantic Ambiguity Detection in Sentence Classification using Task-Specific Embeddings (Kim et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-industry.41.pdf