<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="nikolaev-pado-2023-argument">
    <titleInfo>
        <title>The argument–adjunct distinction in BERT: A FrameNet-based investigation</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Dmitry</namePart>
        <namePart type="family">Nikolaev</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Sebastian</namePart>
        <namePart type="family">Padó</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2023-06</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 15th International Conference on Computational Semantics</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Maxime</namePart>
            <namePart type="family">Amblard</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Ellen</namePart>
            <namePart type="family">Breitholtz</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Nancy, France</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>The distinction between arguments and adjuncts is a fundamental assumption of several linguistic theories. In this study, we investigate to what extent this distinction is picked up by a Transformer-based language model. We use BERT as a case study, operationalizing arguments and adjuncts as core and non-core FrameNet frame elements, respectively, and tying them to activations of particular BERT neurons. We present evidence, from English and Korean, that BERT learns more dedicated representations for arguments than for adjuncts when fine-tuned on the FrameNet frame-identification task. We also show that this distinction is already present in a weaker form in the vanilla pre-trained model.</abstract>
    <identifier type="citekey">nikolaev-pado-2023-argument</identifier>
    <location>
        <url>https://aclanthology.org/2023.iwcs-1.23</url>
    </location>
    <part>
        <date>2023-06</date>
        <extent unit="page">
            <start>233</start>
            <end>239</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T The argument–adjunct distinction in BERT: A FrameNet-based investigation
%A Nikolaev, Dmitry
%A Padó, Sebastian
%Y Amblard, Maxime
%Y Breitholtz, Ellen
%S Proceedings of the 15th International Conference on Computational Semantics
%D 2023
%8 June
%I Association for Computational Linguistics
%C Nancy, France
%F nikolaev-pado-2023-argument
%X The distinction between arguments and adjuncts is a fundamental assumption of several linguistic theories. In this study, we investigate to what extent this distinction is picked up by a Transformer-based language model. We use BERT as a case study, operationalizing arguments and adjuncts as core and non-core FrameNet frame elements, respectively, and tying them to activations of particular BERT neurons. We present evidence, from English and Korean, that BERT learns more dedicated representations for arguments than for adjuncts when fine-tuned on the FrameNet frame-identification task. We also show that this distinction is already present in a weaker form in the vanilla pre-trained model.
%U https://aclanthology.org/2023.iwcs-1.23
%P 233-239

Markdown (Informal)

[The argument–adjunct distinction in BERT: A FrameNet-based investigation](https://aclanthology.org/2023.iwcs-1.23) (Nikolaev & Padó, IWCS 2023)

• The argument–adjunct distinction in BERT: A FrameNet-based investigation (Nikolaev & Padó, IWCS 2023)

ACL

• Dmitry Nikolaev and Sebastian Padó. 2023. The argument–adjunct distinction in BERT: A FrameNet-based investigation. In Proceedings of the 15th International Conference on Computational Semantics, pages 233–239, Nancy, France. Association for Computational Linguistics.