<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="jang-etal-2023-figurative">
    <titleInfo>
        <title>Figurative Language Processing: A Linguistically Informed Feature Analysis of the Behavior of Language Models and Humans</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Hyewon</namePart>
        <namePart type="family">Jang</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Qi</namePart>
        <namePart type="family">Yu</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Diego</namePart>
        <namePart type="family">Frassinelli</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2023-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Findings of the Association for Computational Linguistics: ACL 2023</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Anna</namePart>
            <namePart type="family">Rogers</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Jordan</namePart>
            <namePart type="family">Boyd-Graber</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Naoaki</namePart>
            <namePart type="family">Okazaki</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Toronto, Canada</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Recent years have witnessed a growing interest in investigating what Transformer-based language models (TLMs) actually learn from the training data. This is especially relevant for complex tasks such as the understanding of non-literal meaning. In this work, we probe the performance of three black-box TLMs and two intrinsically transparent white-box models on figurative language classification of sarcasm, similes, idioms, and metaphors. We conduct two studies on the classification results to provide insights into the inner workings of such models. With our first analysis on feature importance, we identify crucial differences in model behavior. With our second analysis using an online experiment with human participants, we inspect different linguistic characteristics of the four figurative language types.</abstract>
    <identifier type="citekey">jang-etal-2023-figurative</identifier>
    <identifier type="doi">10.18653/v1/2023.findings-acl.622</identifier>
    <location>
        <url>https://aclanthology.org/2023.findings-acl.622</url>
    </location>
    <part>
        <date>2023-07</date>
        <extent unit="page">
            <start>9816</start>
            <end>9832</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Figurative Language Processing: A Linguistically Informed Feature Analysis of the Behavior of Language Models and Humans
%A Jang, Hyewon
%A Yu, Qi
%A Frassinelli, Diego
%Y Rogers, Anna
%Y Boyd-Graber, Jordan
%Y Okazaki, Naoaki
%S Findings of the Association for Computational Linguistics: ACL 2023
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada
%F jang-etal-2023-figurative
%X Recent years have witnessed a growing interest in investigating what Transformer-based language models (TLMs) actually learn from the training data. This is especially relevant for complex tasks such as the understanding of non-literal meaning. In this work, we probe the performance of three black-box TLMs and two intrinsically transparent white-box models on figurative language classification of sarcasm, similes, idioms, and metaphors. We conduct two studies on the classification results to provide insights into the inner workings of such models. With our first analysis on feature importance, we identify crucial differences in model behavior. With our second analysis using an online experiment with human participants, we inspect different linguistic characteristics of the four figurative language types.
%R 10.18653/v1/2023.findings-acl.622
%U https://aclanthology.org/2023.findings-acl.622
%U https://doi.org/10.18653/v1/2023.findings-acl.622
%P 9816-9832

Markdown (Informal)

[Figurative Language Processing: A Linguistically Informed Feature Analysis of the Behavior of Language Models and Humans](https://aclanthology.org/2023.findings-acl.622) (Jang et al., Findings 2023)

• Figurative Language Processing: A Linguistically Informed Feature Analysis of the Behavior of Language Models and Humans (Jang et al., Findings 2023)

ACL

• Hyewon Jang, Qi Yu, and Diego Frassinelli. 2023. Figurative Language Processing: A Linguistically Informed Feature Analysis of the Behavior of Language Models and Humans. In Findings of the Association for Computational Linguistics: ACL 2023, pages 9816–9832, Toronto, Canada. Association for Computational Linguistics.