Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions

David M.  Howcroft; Anya Belz; Miruna  Clinci; Dimitra  Gkatzia; Sadid A.  Hasa; Saad  Mahamood; Simon Mille; Emiel  van Miltenbur; Sashank  Santhana; Verena  Riese

Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions

David M. Howcroft
, Anya Belz
, Miruna Clinci
, Dimitra Gkatzia
, Sadid A. Hasa
, Saad Mahamood
, Simon Mille
, Emiel van Miltenbur
, Sashank Santhana
, Verena Riese

Research output: Chapter in Book/Conference proceeding with ISSN or ISBN › Conference contribution with ISSN or ISBN › peer-review

Original language	English
Title of host publication	International Natural Language Generation Conference 2020 (INLG'20)
Publisher	Association for Computational Linguistics
Pages	169-182
ISBN (Print)	9781952148545
Publication status	Published - Dec 2020
Event	13th International Conference on Natural Language Generation - Dublin City University, Dublin, Ireland Duration: 15 Dec 2020 → 18 Dec 2020 https://www.inlg2020.org/

Conference

Conference	13th International Conference on Natural Language Generation
Abbreviated title	INLG 2020
Country/Territory	Ireland
City	Dublin
Period	15/12/20 → 18/12/20
Internet address	https://www.inlg2020.org/

Access to Document

2020.inlg-1.23Final published version, 1,000 KBLicence: CC BY

https://www.aclweb.org/anthology/2020.inlg-1.23Licence: CC BY

Cite this

Howcroft, D. M., Belz, A., Clinci, M., Gkatzia, D., Hasa, S. A., Mahamood, S., Mille, S., van Miltenbur, E., Santhana, S., & Riese, V. (2020). Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions. In International Natural Language Generation Conference 2020 (INLG'20) (pp. 169-182). Association for Computational Linguistics. https://www.aclweb.org/anthology/2020.inlg-1.23

@inproceedings{00c3fcaf66a0480a9af9eab93f8a5cd3,

title = "Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions",

author = "Howcroft, \{David M.\} and Anya Belz and Miruna Clinci and Dimitra Gkatzia and Hasa, \{Sadid A.\} and Saad Mahamood and Simon Mille and \{van Miltenbur\}, Emiel and Sashank Santhana and Verena Riese",

year = "2020",

month = dec,

language = "English",

isbn = "9781952148545",

pages = "169--182",

booktitle = "International Natural Language Generation Conference 2020 (INLG'20)",

publisher = "Association for Computational Linguistics",

note = "13th International Conference on Natural Language Generation, INLG 2020 ; Conference date: 15-12-2020 Through 18-12-2020",

url = "https://www.inlg2020.org/",

}

Howcroft, DM, Belz, A, Clinci, M, Gkatzia, D, Hasa, SA, Mahamood, S, Mille, S, van Miltenbur, E, Santhana, S & Riese, V 2020, Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions. in International Natural Language Generation Conference 2020 (INLG'20). Association for Computational Linguistics, pp. 169-182, 13th International Conference on Natural Language Generation, Dublin, Ireland, 15/12/20. <https://www.aclweb.org/anthology/2020.inlg-1.23>

Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions. / Howcroft, David M. ; Belz, Anya; Clinci, Miruna et al.
International Natural Language Generation Conference 2020 (INLG'20). Association for Computational Linguistics, 2020. p. 169-182.

Research output: Chapter in Book/Conference proceeding with ISSN or ISBN › Conference contribution with ISSN or ISBN › peer-review

TY - GEN

T1 - Twenty Years of Confusion in Human Evaluation

T2 - 13th International Conference on Natural Language Generation

AU - Howcroft, David M.

AU - Belz, Anya

AU - Clinci, Miruna

AU - Gkatzia, Dimitra

AU - Hasa, Sadid A.

AU - Mahamood, Saad

AU - Mille, Simon

AU - van Miltenbur, Emiel

AU - Santhana, Sashank

AU - Riese, Verena

PY - 2020/12

Y1 - 2020/12

UR - https://www.inlg2020.org/accepted-papers

M3 - Conference contribution with ISSN or ISBN

SN - 9781952148545

SP - 169

EP - 182

BT - International Natural Language Generation Conference 2020 (INLG'20)

PB - Association for Computational Linguistics

Y2 - 15 December 2020 through 18 December 2020

ER -

Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions

Conference

Access to Document

Other files and links

Cite this