Please use this identifier to cite or link to this item: doi:10.22028/D291-38635
Volltext verfügbar? / Dokumentlieferung
Title: Is there less annotator agreement when the discourse relation is underspecified?
Author(s): Hoek, Jet
Scholman, Merel Cleo Johanna
Sanders, Ted J. M.
Language: English
Title: Proceedings of the Integrating Perspectives on Discourse Annotation (DiscAnn) Workshop
Pages: 1-6
Year of Publication: 2021
Place of the conference: Tübingen, Germany
DDC notations: 004 Computer science, internet
Publikation type: Conference Paper
Abstract: When annotating coherence relations, interannotator agreement tends to be lower on implicit relations than on relations that are explicitly marked by means of a connective or a cue phrase. This paper explores one possible explanation for this: the additional inferencing involved in interpreting implicit rela tions compared to explicit relations. If this is the main source of disagreements, agreement should be highly related to the specificity of the connective. Using the CCR framework, we annotated relations from TED talks that were marked by a very specific marker, marked by a highly ambiguous connective, or not marked by means of a connective at all. We indeed reached higher interannotator agreement on explicit than on implicit relations. However, agreement on underspecified relations was not necessarily in between, which is what would be expected if agreement on implicit relations mainly suffers because annotators have less specific instructions for inferring the relation.
Link to this record: urn:nbn:de:bsz:291--ds-386352
Date of registration: 2-Jan-2023
Faculty: MI - Fakultät für Mathematik und Informatik
Department: MI - Informatik
Professorship: MI - Prof. Dr. Vera Demberg
Collections:SciDok - Der Wissenschaftsserver der Universität des Saarlandes

Files for this record:
There are no files associated with this item.

Items in SciDok are protected by copyright, with all rights reserved, unless otherwise indicated.