Negative documents are positive: Improving event extraction performance using overlooked negative data

Osman Mutlu, Ali Hürriyetoğlu


Abstract
The scarcity of data poses a significant challenge in closed-domain event extraction, as is common in complex NLP tasks. This limitation primarily arises from the intricate nature of the annotation process. To address this issue, we present a multi-task model structure and training approach that leverages the additional data, which is found as not having any event information at document and sentence levels, generated during the event annotation process. By incorporating this supplementary data, our proposed framework demonstrates enhanced robustness and, in some scenarios, improved performance. A particularly noteworthy observation is that including only negative documents in addition to the original data contributes to performance enhancement. Our findings offer promising insights into leveraging extra data to mitigate data scarcity challenges in closed-domain event extraction.
Anthology ID:
2023.case-1.17
Volume:
Proceedings of the 6th Workshop on Challenges and Applications of Automated Extraction of Socio-political Events from Text
Month:
sEPTEMBER
Year:
2023
Address:
Varna, Bulgaria
Editors:
Ali Hürriyetoğlu, Hristo Tanev, Vanni Zavarella, Reyyan Yeniterzi, Erdem Yörük, Milena Slavcheva
Venues:
CASE | WS
SIG:
Publisher:
INCOMA Ltd., Shoumen, Bulgaria
Note:
Pages:
124–135
Language:
URL:
https://aclanthology.org/2023.case-1.17
DOI:
Bibkey:
Cite (ACL):
Osman Mutlu and Ali Hürriyetoğlu. 2023. Negative documents are positive: Improving event extraction performance using overlooked negative data. In Proceedings of the 6th Workshop on Challenges and Applications of Automated Extraction of Socio-political Events from Text, pages 124–135, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
Cite (Informal):
Negative documents are positive: Improving event extraction performance using overlooked negative data (Mutlu & Hürriyetoğlu, CASE-WS 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.case-1.17.pdf