What is the Real Intention behind this Question? Dataset Collection and Intention Classification

Maryam Sadat Mirzaei, Kourosh Meshgi, Satoshi Sekine


Abstract
Asking and answering questions are inseparable parts of human social life. The primary purposes of asking questions are to gain knowledge or request help which has been the subject of question-answering studies. However, questions can also reflect negative intentions and include implicit offenses, such as highlighting one’s lack of knowledge or bolstering an alleged superior knowledge, which can lead to conflict in conversations; yet has been scarcely researched. This paper is the first study to introduce a dataset (Question Intention Dataset) that includes questions with positive/neutral and negative intentions and the underlying intention categories within each group. We further conduct a meta-analysis to highlight tacit and apparent intents. We also propose a classification method using Transformers augmented by TF-IDF-based features and report the results of several models for classifying the main intention categories. We aim to highlight the importance of taking intentions into account, especially implicit and negative ones, to gain insight into conflict-evoking questions and better understand human-human communication on the web for NLP applications.
Anthology ID:
2023.acl-long.761
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
13606–13622
Language:
URL:
https://aclanthology.org/2023.acl-long.761
DOI:
10.18653/v1/2023.acl-long.761
Bibkey:
Cite (ACL):
Maryam Sadat Mirzaei, Kourosh Meshgi, and Satoshi Sekine. 2023. What is the Real Intention behind this Question? Dataset Collection and Intention Classification. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 13606–13622, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
What is the Real Intention behind this Question? Dataset Collection and Intention Classification (Mirzaei et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.761.pdf
Video:
 https://aclanthology.org/2023.acl-long.761.mp4