The TUNA-REG challenge 2009: overview and evaluation results

Anja Belz, Eric Kow, Albert Gatt

Research output: Contribution to conferenceAbstractResearch

Abstract

The TUNA-REG’09 Challenge was one of the shared-task evaluation competitions at Generation Challenges 2009. TUNAREG’09 used data from the TUNA Corpus of paired representations of entities and human-authored referring expressions. The shared task was to create systems that generate referring expressions for entities given representations of sets of entities and their properties. Four teams submitted six systems to TUNAREG’ 09. We evaluated the six systems and two sets of human-authored referring expressions using several automatic intrinsic measures, a human-assessed intrinsic evaluation and a human task performance experiment. This report describes the TUNAREG task and the evaluation methods used, and presents the evaluation results.
Original languageEnglish
Pages174-182
Number of pages9
Publication statusPublished - 30 Mar 2009
EventGeneration Challenges 2009 - Athens, Greece
Duration: 30 Mar 2009 → …

Conference

ConferenceGeneration Challenges 2009
Period30/03/09 → …

Fingerprint

Experiments

Cite this

Belz, A., Kow, E., & Gatt, A. (2009). The TUNA-REG challenge 2009: overview and evaluation results. 174-182. Abstract from Generation Challenges 2009, .
Belz, Anja ; Kow, Eric ; Gatt, Albert. / The TUNA-REG challenge 2009: overview and evaluation results. Abstract from Generation Challenges 2009, .9 p.
@conference{7238f088bde84eff84da8ed772b590cd,
title = "The TUNA-REG challenge 2009: overview and evaluation results",
abstract = "The TUNA-REG’09 Challenge was one of the shared-task evaluation competitions at Generation Challenges 2009. TUNAREG’09 used data from the TUNA Corpus of paired representations of entities and human-authored referring expressions. The shared task was to create systems that generate referring expressions for entities given representations of sets of entities and their properties. Four teams submitted six systems to TUNAREG’ 09. We evaluated the six systems and two sets of human-authored referring expressions using several automatic intrinsic measures, a human-assessed intrinsic evaluation and a human task performance experiment. This report describes the TUNAREG task and the evaluation methods used, and presents the evaluation results.",
author = "Anja Belz and Eric Kow and Albert Gatt",
year = "2009",
month = "3",
day = "30",
language = "English",
pages = "174--182",
note = "Generation Challenges 2009 ; Conference date: 30-03-2009",

}

Belz, A, Kow, E & Gatt, A 2009, 'The TUNA-REG challenge 2009: overview and evaluation results' Generation Challenges 2009, 30/03/09, pp. 174-182.

The TUNA-REG challenge 2009: overview and evaluation results. / Belz, Anja; Kow, Eric; Gatt, Albert.

2009. 174-182 Abstract from Generation Challenges 2009, .

Research output: Contribution to conferenceAbstractResearch

TY - CONF

T1 - The TUNA-REG challenge 2009: overview and evaluation results

AU - Belz, Anja

AU - Kow, Eric

AU - Gatt, Albert

PY - 2009/3/30

Y1 - 2009/3/30

N2 - The TUNA-REG’09 Challenge was one of the shared-task evaluation competitions at Generation Challenges 2009. TUNAREG’09 used data from the TUNA Corpus of paired representations of entities and human-authored referring expressions. The shared task was to create systems that generate referring expressions for entities given representations of sets of entities and their properties. Four teams submitted six systems to TUNAREG’ 09. We evaluated the six systems and two sets of human-authored referring expressions using several automatic intrinsic measures, a human-assessed intrinsic evaluation and a human task performance experiment. This report describes the TUNAREG task and the evaluation methods used, and presents the evaluation results.

AB - The TUNA-REG’09 Challenge was one of the shared-task evaluation competitions at Generation Challenges 2009. TUNAREG’09 used data from the TUNA Corpus of paired representations of entities and human-authored referring expressions. The shared task was to create systems that generate referring expressions for entities given representations of sets of entities and their properties. Four teams submitted six systems to TUNAREG’ 09. We evaluated the six systems and two sets of human-authored referring expressions using several automatic intrinsic measures, a human-assessed intrinsic evaluation and a human task performance experiment. This report describes the TUNAREG task and the evaluation methods used, and presents the evaluation results.

M3 - Abstract

SP - 174

EP - 182

ER -

Belz A, Kow E, Gatt A. The TUNA-REG challenge 2009: overview and evaluation results. 2009. Abstract from Generation Challenges 2009, .