Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions

David M.  Howcroft; Anya Belz; Miruna  Clinci; Dimitra  Gkatzia; Sadid A.  Hasa; Saad  Mahamood; Simon Mille; Emiel  van Miltenbur; Sashank  Santhana; Verena  Riese

Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions

David M. Howcroft, Anya Belz, Miruna Clinci, Dimitra Gkatzia, Sadid A. Hasa, Saad Mahamood, Simon Mille, Emiel van Miltenbur, Sashank Santhana, Verena Riese

Research output: Chapter in Book/Conference proceeding with ISSN or ISBN › Conference contribution with ISSN or ISBN › peer-review

Original language	English
Title of host publication	International Natural Language Generation Conference 2020 (INLG'20)
Publisher	Association for Computational Linguistics
Pages	169-182
ISBN (Print)	9781952148545
Publication status	Published - Dec 2020
Event	13th International Conference on Natural Language Generation - Dublin City University, Dublin, Ireland Duration: 15 Dec 2020 → 18 Dec 2020 https://www.inlg2020.org/

Conference

Conference	13th International Conference on Natural Language Generation
Abbreviated title	INLG 2020
Country/Territory	Ireland
City	Dublin
Period	15/12/20 → 18/12/20
Internet address	https://www.inlg2020.org/

Access to Document

2020.inlg-1.23Final published version, 1,000 KBLicence: CC BY

https://www.aclweb.org/anthology/2020.inlg-1.23Licence: CC BY

Cite this

Howcroft, D. M., Belz, A., Clinci, M., Gkatzia, D., Hasa, S. A., Mahamood, S., Mille, S., van Miltenbur, E., Santhana, S., & Riese, V. (2020). Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions. In International Natural Language Generation Conference 2020 (INLG'20) (pp. 169-182). Association for Computational Linguistics. https://www.aclweb.org/anthology/2020.inlg-1.23

@inproceedings{00c3fcaf66a0480a9af9eab93f8a5cd3,

title = "Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions",

author = "Howcroft, {David M.} and Anya Belz and Miruna Clinci and Dimitra Gkatzia and Hasa, {Sadid A.} and Saad Mahamood and Simon Mille and {van Miltenbur}, Emiel and Sashank Santhana and Verena Riese",

year = "2020",

month = dec,

language = "English",

isbn = "9781952148545",

pages = "169--182",

booktitle = "International Natural Language Generation Conference 2020 (INLG'20)",

publisher = "Association for Computational Linguistics",

note = "13th International Conference on Natural Language Generation, INLG 2020 ; Conference date: 15-12-2020 Through 18-12-2020",

url = "https://www.inlg2020.org/",

}

Howcroft, DM, Belz, A, Clinci, M, Gkatzia, D, Hasa, SA, Mahamood, S, Mille, S, van Miltenbur, E, Santhana, S & Riese, V 2020, Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions. in International Natural Language Generation Conference 2020 (INLG'20). Association for Computational Linguistics, pp. 169-182, 13th International Conference on Natural Language Generation, Dublin, Ireland, 15/12/20. <https://www.aclweb.org/anthology/2020.inlg-1.23>

Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions. / Howcroft, David M. ; Belz, Anya; Clinci, Miruna et al.
International Natural Language Generation Conference 2020 (INLG'20). Association for Computational Linguistics, 2020. p. 169-182.

Research output: Chapter in Book/Conference proceeding with ISSN or ISBN › Conference contribution with ISSN or ISBN › peer-review

TY - GEN

T1 - Twenty Years of Confusion in Human Evaluation

T2 - 13th International Conference on Natural Language Generation

AU - Howcroft, David M.

AU - Belz, Anya

AU - Clinci, Miruna

AU - Gkatzia, Dimitra

AU - Hasa, Sadid A.

AU - Mahamood, Saad

AU - Mille, Simon

AU - van Miltenbur, Emiel

AU - Santhana, Sashank

AU - Riese, Verena

PY - 2020/12

Y1 - 2020/12

UR - https://www.inlg2020.org/accepted-papers

M3 - Conference contribution with ISSN or ISBN

SN - 9781952148545

SP - 169

EP - 182

BT - International Natural Language Generation Conference 2020 (INLG'20)

PB - Association for Computational Linguistics

Y2 - 15 December 2020 through 18 December 2020

ER -

Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions

Conference

Access to Document

Other files and links

Cite this