Please use this identifier to cite or link to this item:
Volltext verfügbar? / Dokumentlieferung
doi:10.22028/D291-38654
Title: | Does the Order of Training Samples Matter? Improving Neural Data-to-Text Generation with Curriculum Learning |
Author(s): | Chang, Ernie Yeh, Hui-Syuan Demberg, Vera |
Language: | English |
Publisher/Platform: | arXiv |
Year of Publication: | 2021 |
DDC notations: | 400 Language, linguistics |
Publikation type: | Other |
Abstract: | Recent advancements in data-to-text generation largely take on the form of neural end-to-end systems. Efforts have been dedicated to improving text generation systems by changing the order of training samples in a process known as curriculum learning. Past research on sequence-to-sequence learning showed that curriculum learning helps to improve both the performance and convergence speed. In this work, we delve into the same idea surrounding the training samples consisting of structured data and text pairs, where at each update, the curriculum framework selects training samples based on the model's competence. Specifically, we experiment with various difficulty metrics and put forward a soft edit distance metric for ranking training samples. Our benchmarks show faster convergence speed where training time is reduced by 38.7% and performance is boosted by 4.84 BLEU. |
URL of the first publication: | https://arxiv.org/abs/2102.03554 |
Link to this record: | urn:nbn:de:bsz:291--ds-386544 hdl:20.500.11880/34846 http://dx.doi.org/10.22028/D291-38654 |
Date of registration: | 4-Jan-2023 |
Notes: | Preprint |
Faculty: | MI - Fakultät für Mathematik und Informatik |
Department: | MI - Informatik |
Professorship: | MI - Prof. Dr. Vera Demberg |
Collections: | SciDok - Der Wissenschaftsserver der Universität des Saarlandes |
Files for this record:
There are no files associated with this item.
Items in SciDok are protected by copyright, with all rights reserved, unless otherwise indicated.