Intrinsic vs. extrinsic evaluation measures for referring expression generation

Anja Belz, Albert Gatt

Research output: Chapter in Book/Conference proceeding with ISSN or ISBNConference contribution with ISSN or ISBN

Abstract

In this paper we present research in which we apply (i) the kind of intrinsic evaluation metrics that are characteristic of current comparative HLT evaluation, and (ii) extrinsic, human task-performance evaluations more in keeping with NLG traditions, to 15 systems implementing a language generation task. We analyse the evaluation results and find that there are no significant correlations between intrinsic and extrinsic evaluation measures for this task.
Original languageEnglish
Title of host publicationProceedings of the 46th Annual Meeting of the Association for Computational Linguistics (ACL'08)
Place of PublicationColumbus, Ohio
Pages197-200
Number of pages4
Publication statusPublished - 1 Jan 2008
EventProceedings of the 46th Annual Meeting of the Association for Computational Linguistics (ACL'08) - Columbus, Ohio, USA
Duration: 1 Jan 2008 → …

Conference

ConferenceProceedings of the 46th Annual Meeting of the Association for Computational Linguistics (ACL'08)
Period1/01/08 → …

Cite this

Belz, A., & Gatt, A. (2008). Intrinsic vs. extrinsic evaluation measures for referring expression generation. In Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics (ACL'08) (pp. 197-200). http://aclweb.org/anthology-new/P/P08/P08-2050.pdf