Joint End-to-end Semantic Proto-role Labeling

Elizabeth Spaulding, Gary Kazantsev, Mark Dredze


Abstract
Semantic proto-role labeling (SPRL) assigns properties to arguments based on a series of binary labels. While multiple studies have evaluated various approaches to SPRL, it has only been studied in-depth as a standalone task using gold predicate/argument pairs. How do SPRL systems perform as part of an information extraction pipeline? We model SPRL jointly with predicate-argument extraction using a deep transformer model. We find that proto-role labeling is surprisingly robust in this setting, with only a small decrease when using predicted arguments. We include a detailed analysis of each component of the joint system, and an error analysis to understand correlations in errors between system stages. Finally, we study the effects of annotation errors on SPRL.
Anthology ID:
2023.acl-short.63
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
723–736
Language:
URL:
https://aclanthology.org/2023.acl-short.63
DOI:
10.18653/v1/2023.acl-short.63
Bibkey:
Cite (ACL):
Elizabeth Spaulding, Gary Kazantsev, and Mark Dredze. 2023. Joint End-to-end Semantic Proto-role Labeling. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 723–736, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Joint End-to-end Semantic Proto-role Labeling (Spaulding et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-short.63.pdf
Video:
 https://aclanthology.org/2023.acl-short.63.mp4