Bitte benutzen Sie diese Referenz, um auf diese Ressource zu verweisen: doi:10.22028/D291-30106
Titel: Semantic Entropy in Language Comprehension
VerfasserIn: Venhuizen, Noortje J.
Crocker, Matthew W.
Brouwer, Harm
Sprache: Englisch
Titel: Entropy
Bandnummer: 21
Heft: 12
Verlag/Plattform: MDPI
Erscheinungsjahr: 2019
Freie Schlagwörter: natural language
entropy
neural networks
DDC-Sachgruppe: 100 Philosophie
400 Sprache, Linguistik
Dokumenttyp: Journalartikel / Zeitschriftenartikel
Abstract: Language is processed on a more or less word-by-word basis, and the processing difficulty induced by each word is affected by our prior linguistic experience as well as our general knowledge about the world. Surprisal and entropy reduction have been independently proposed as linking theories between word processing difficulty and probabilistic language models. Extant models, however, are typically limited to capturing linguistic experience and hence cannot account for the influence of world knowledge. A recent comprehension model by Venhuizen, Crocker, and Brouwer (2019, Discourse Processes) improves upon this situation by instantiating a comprehension-centric metric of surprisal that integrates linguistic experience and world knowledge at the level of interpretation and combines them in determining online expectations. Here, we extend this work by deriving a comprehension-centric metric of entropy reduction from this model. In contrast to previous work, which has found that surprisal and entropy reduction are not easily dissociated, we do find a clear dissociation in our model. While both surprisal and entropy reduction derive from the same cognitive process—the word-by-word updating of the unfolding interpretation—they reflect different aspects of this process: state-by-state expectation (surprisal) versus end-state confirmation (entropy reduction).
DOI der Erstveröffentlichung: 10.3390/e21121159
Link zu diesem Datensatz: urn:nbn:de:bsz:291--ds-301069
hdl:20.500.11880/30069
http://dx.doi.org/10.22028/D291-30106
ISSN: 1099-4300
Datum des Eintrags: 19-Nov-2020
Fakultät: P - Philosophische Fakultät
Fachrichtung: P - Sprachwissenschaft und Sprachtechnologie
Professur: P - Prof. Dr. Matthew W. Crocker
Sammlung:SciDok - Der Wissenschaftsserver der Universität des Saarlandes

Dateien zu diesem Datensatz:
Datei Beschreibung GrößeFormat 
entropy-21-01159-v2.pdf1,32 MBAdobe PDFÖffnen/Anzeigen


Diese Ressource wurde unter folgender Copyright-Bestimmung veröffentlicht: Lizenz von Creative Commons Creative Commons