Bitte benutzen Sie diese Referenz, um auf diese Ressource zu verweisen:
Volltext verfügbar? / Dokumentlieferung
doi:10.22028/D291-29404
Titel: | Multimodal Dialogue System Evaluation : A Case Study Applying Usability Standards |
VerfasserIn: | Malchanau, Andrei Petukhova, Volha Bunt, Harry |
HerausgeberIn: | D'Haro, Luis Fernando Banchs, Rafael E. Li, Haizhou |
Sprache: | Englisch |
Titel: | Proceedings Ninth International Workshop on Spoken Dialogue Systems Technology |
Startseite: | 145 |
Endseite: | 159 |
Verlag/Plattform: | Springer |
Erscheinungsjahr: | 2019 |
Erscheinungsort: | Singapore |
Titel der Konferenz: | IWSDS 2019 |
Konferenzort: | Siracusa, Italy |
Dokumenttyp: | Konferenzbeitrag (in einem Konferenzband / InProceedings erschienener Beitrag) |
Abstract: | This paper presents an approach to the evaluation of multimodal dialogue systems, applying usability metrics defined in ISO standards. Users’ perceptions of effectiveness, efficiency and satisfaction were correlated with various performance metrics derived from system logfiles and reference annotations. Usability experts rated questions from a preliminary 110-items questionnaire, and an assessment of their agreement on usability concepts has led to a selection of eight main factors: task completion and quality, robustness, learnability, flexibility, likeability, ease of use and usefulness (value) of an application. Based on these factors, an internally consistent and reliable questionnaire with 32 items (Cronbach’s alpha of 0.87) was produced. This questionnaire was used to evaluate the Virtual Negotiation Coaching system for metacognitive skills training in a multi-issue bargaining setting. The observed correlations between usability perception and derived performance metrics suggest that the overall system usability is determined by the quality of agreements reached, by the robustness and flexibility of the interaction, and by the quality of system responses. |
DOI der Erstveröffentlichung: | 10.1007/978-981-13-9443-0_13 |
URL der Erstveröffentlichung: | https://link.springer.com/chapter/10.1007/978-981-13-9443-0_13 |
Link zu diesem Datensatz: | hdl:20.500.11880/28382 http://dx.doi.org/10.22028/D291-29404 |
ISBN: | 978-981-13-9442-3 978-981-13-9443-0 |
Datum des Eintrags: | 27-Nov-2019 |
Fakultät: | P - Philosophische Fakultät |
Fachrichtung: | P - Sprachwissenschaft und Sprachtechnologie |
Professur: | P - Prof. Dr. Dietrich Klakow |
Sammlung: | SciDok - Der Wissenschaftsserver der Universität des Saarlandes |
Dateien zu diesem Datensatz:
Es gibt keine Dateien zu dieser Ressource.
Alle Ressourcen in diesem Repository sind urheberrechtlich geschützt.