Polarized Opinion Detection Improves the Detection of Toxic Language

John Pavlopoulos, Aristidis Likas


Abstract
Distance from unimodality (DFU) has been found to correlate well with human judgment for the assessment of polarized opinions. However, its un-normalized nature makes it less intuitive and somewhat difficult to exploit in machine learning (e.g., as a supervised signal). In this work a normalized version of this measure, called nDFU, is proposed that leads to better assessment of the degree of polarization. Then, we propose a methodology for K-class text classification, based on nDFU, that exploits polarized texts in the dataset. Such polarized instances are assigned to a separate K+1 class, so that a K+1-class classifier is trained. An empirical analysis on three datasets for abusive language detection, shows that nDFU can be used to model polarized annotations and prevent them from harming the classification performance. Finally, we further exploit nDFU to specify conditions that could explain polarization given a dimension and present text examples that polarized the annotators when the dimension was gender and race. Our code is available at https://github.com/ipavlopoulos/ndfu.
Anthology ID:
2024.eacl-long.117
Volume:
Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
March
Year:
2024
Address:
St. Julian’s, Malta
Editors:
Yvette Graham, Matthew Purver
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1946–1958
Language:
URL:
https://aclanthology.org/2024.eacl-long.117
DOI:
Bibkey:
Cite (ACL):
John Pavlopoulos and Aristidis Likas. 2024. Polarized Opinion Detection Improves the Detection of Toxic Language. In Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1946–1958, St. Julian’s, Malta. Association for Computational Linguistics.
Cite (Informal):
Polarized Opinion Detection Improves the Detection of Toxic Language (Pavlopoulos & Likas, EACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.eacl-long.117.pdf
Software:
 2024.eacl-long.117.software.zip