The GREC challenge 2008; Overview and evaluation results

Anja Belz, Eric Kow, Jette Viethen, Albert Gatt

Research output: Chapter in Book/Conference proceeding with ISSN or ISBNConference contribution with ISSN or ISBN

Abstract

The GREC Task at REG’08 required participating systems to select coreference chains to the main subject of short encyclopaedic texts collected from Wikipedia. Three teams submitted a total of 6 systems, and we additionally created four baseline systems. Systems were tested automatically using a range of existing intrinsic metrics. We also evaluated systems extrinsically by applying coreference resolution tools to the outputs and measuring the success of the tools. In addition, systems were tested in a reading/comprehension experiment involving human subjects. This report describes the GREC Task and the evaluation methods, gives brief descriptions of the participating systems, and presents the evaluation results.
Original languageEnglish
Title of host publication5th International Natural Language Generation Conference (INLG'08)
Place of PublicationStroudsburg, PA, USA
PublisherAssociation for Computational Linguistics
Pages183-199
Number of pages17
DOIs
Publication statusPublished - 1 Jan 2008
Event5th International Natural Language Generation Conference (INLG'08) - Ohio, USA
Duration: 1 Jan 2008 → …

Conference

Conference5th International Natural Language Generation Conference (INLG'08)
Period1/01/08 → …

Fingerprint Dive into the research topics of 'The GREC challenge 2008; Overview and evaluation results'. Together they form a unique fingerprint.

  • Cite this

    Belz, A., Kow, E., Viethen, J., & Gatt, A. (2008). The GREC challenge 2008; Overview and evaluation results. In 5th International Natural Language Generation Conference (INLG'08) (pp. 183-199). Association for Computational Linguistics. https://doi.org/10.1.1.140.9786