Abstract
In this paper we present research in which we apply (i) the kind of intrinsic evaluation metrics that are characteristic of current comparative HLT evaluation, and (ii) extrinsic, human task-performance evaluations more in keeping with NLG traditions, to 15 systems implementing a language generation task. We analyse the evaluation results and find that there are no significant correlations between intrinsic and extrinsic evaluation measures for this task.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics (ACL'08) |
| Place of Publication | Columbus, Ohio |
| Pages | 197-200 |
| Number of pages | 4 |
| Publication status | Published - 1 Jan 2008 |
| Event | Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics (ACL'08) - Columbus, Ohio, USA Duration: 1 Jan 2008 → … |
Conference
| Conference | Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics (ACL'08) |
|---|---|
| Period | 1/01/08 → … |