The GREC named entity generation challenge 2009; Overview and evaluation results

Anja Belz, Eric Kow, Jette Viethen

Research output: Chapter in Book/Conference proceeding with ISSN or ISBNConference contribution with ISSN or ISBN

Abstract

The GREC-NEG Task at Generation Challenges 2009 required participating systems to select coreference chains for all people entities mentioned in short encyclopaedic texts about people collected from Wikipedia. Three teams submitted six systems in total, and we additionally created four baseline systems. Systems were tested automatically using a range of existing intrinsic metrics. We also evaluated systems extrinsically by applying coreference resolution tools to the outputs and measuring the success of the tools. In addition, systems were tested in an intrinsic evaluation involving human judges. This report describes the GREC-NEG Task and the evaluation methods applied, gives brief descriptions of the participating systems, and presents the evaluation results.
Original languageEnglish
Title of host publication2009 Workshop on Language Generation and Summarisation
Pages88-98
Number of pages11
Publication statusPublished - 2009
Event2009 Workshop on Language Generation and Summarisation - Suntec, Singapore
Duration: 1 Jan 2009 → …

Workshop

Workshop2009 Workshop on Language Generation and Summarisation
Period1/01/09 → …

Cite this

Belz, A., Kow, E., & Viethen, J. (2009). The GREC named entity generation challenge 2009; Overview and evaluation results. In 2009 Workshop on Language Generation and Summarisation (pp. 88-98) http://aclweb.org/anthology-new/W/W09/W09-2817.pdf