Self and peer evaluations of student performance in skills based design projects

Derek Covill, Tim Katz, Steven Smith

Research output: Contribution to conferencePaper

Abstract

Self and peer assessment has been shown to help improve student engagement in assessment tasks, to improve behavior and maintain interest and attention levels, and ultimately to improve student performance. In this study, we critically evaluated the process, reliability, validity, benefits and drawbacks of self and peer assessment in a first year product design project with the aim to also establish a recommended resolution for rubric grade boundaries. Students (n = 51) carried out five separate week-long design projects. They then undertook self and peer assessments and were assessed by the module tutors, by additional staff (both technical and academic not linked to the project module) and students on other years of the course. All staff had reasonable agreement with tutor grades, although there were mixed results on whether these were a valid means to accurately assess the project outcome – depending on which statistical analysis was adopted. For all staff, > 90% of their assessments were within 10% of the benchmark (agreed) grades, while for student self assessments 84.2% were within 10% and for student peer assessments 60.5% of the overall grades were within 10% of the tutor’s grades. When we analysed the data for individual tutor marks for all assessment criteria, 37.3% of grades were within 5% of each other, 85.8% were within 10% of each other, and the range within which 95% of grades could be bound was 20%, suggesting that the resolution of our rubric grade boundaries should be increased to 20% between grades boundaries for individual criteria in such practical assessment tasks in design. More generally, understanding the reliability and validity of assessment processes can help inform the assessment design to ensure an appropriate resolution is used for criteria.
Original languageEnglish
Number of pages6
Publication statusPublished - 10 Sep 2020
EventInternational conference on engineering and product design education - VIA University College, Herning, Denmark
Duration: 10 Sep 202011 Sep 2020
Conference number: 22
https://epde.info/epde2020/

Conference

ConferenceInternational conference on engineering and product design education
CountryDenmark
CityHerning
Period10/09/2011/09/20
Internet address

Keywords

  • self assessment
  • peer assessment
  • reliability
  • validity
  • precision
  • accuracy

Fingerprint Dive into the research topics of 'Self and peer evaluations of student performance in skills based design projects'. Together they form a unique fingerprint.

  • Cite this

    Covill, D., Katz, T., & Smith, S. (2020). Self and peer evaluations of student performance in skills based design projects. Paper presented at International conference on engineering and product design education, Herning, Denmark.