Quantifying Stereotypes in Language

Yang Liu


Abstract
A stereotype is a generalized perception of a specific group of humans. It is often potentially encoded in human language, which is more common in texts on social issues. Previous works simply define a sentence as stereotypical and anti-stereotypical. However, the stereotype of a sentence may require fine-grained quantification. In this paper, to fill this gap, we quantify stereotypes in language by annotating a dataset. We use the pre-trained language models (PLMs) to learn this dataset to predict stereotypes of sentences. Then, we discuss stereotypes about common social issues such as hate speech, sexism, sentiments, and disadvantaged and advantaged groups. We demonstrate the connections and differences between stereotypes and common social issues, and all four studies validate the general findings of the current studies. In addition, our work suggests that fine-grained stereotype scores are a highly relevant and competitive dimension for research on social issues. The models and datasets used in this paper are available at https://anonymous.4open.science/r/quantifying_stereotypes_in_language.
Anthology ID:
2024.eacl-long.74
Volume:
Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
March
Year:
2024
Address:
St. Julian’s, Malta
Editors:
Yvette Graham, Matthew Purver
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1223–1240
Language:
URL:
https://aclanthology.org/2024.eacl-long.74
DOI:
Bibkey:
Cite (ACL):
Yang Liu. 2024. Quantifying Stereotypes in Language. In Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1223–1240, St. Julian’s, Malta. Association for Computational Linguistics.
Cite (Informal):
Quantifying Stereotypes in Language (Liu, EACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.eacl-long.74.pdf
Software:
 2024.eacl-long.74.software.zip