Integrating IRT Analysis into LMS for Item Pool Optimization

Panagiotis Fotaris; Theodoros Mastoras

Integrating IRT Analysis into LMS for Item Pool Optimization

University of Brighton

Research output: Chapter in Book/Conference proceeding with ISSN or ISBN › Conference contribution with ISSN or ISBN › peer-review

Abstract

Due to the computerization of assessment tests, the use of Item Re- sponse Theory (IRT) has become commonplace for educational assessment de- velopment, evaluation, and refinement. When used appropriately by a Learning Management System (LMS), IRT can improve the assessment quality, increase the efficiency of the testing process, and provide in-depth descriptions of item and test properties. This paper introduces a methodological and architectural framework which embeds an IRT analysis tool in an LMS so as to extend its functionality with assessment optimization support. By applying a set of validi- ty rules to the statistical indices produced by the IRT analysis, the enhanced LMS is able to detect several defective items from an item pool which are then reported for reviewing of their content. Assessment refinement is achieved by repeatedly employing this process until all flawed items are eliminated.

Original language	English
Title of host publication	Proceedings of the 2nd Workshop on Technology Enhanced Formative Assessment co-located with EC-TEL 2013, the 8th European Conference on Technology Enhanced Learning
Place of Publication	Paphos, Cyprus
Publisher	CEUR-WS.org
Pages	0-0
Number of pages	1
Volume	1147
Publication status	Published - 17 Sept 2013
Event	Proceedings of the 2nd Workshop on Technology Enhanced Formative Assessment co-located with EC-TEL 2013, the 8th European Conference on Technology Enhanced Learning - Paphos, Cyprus, September 17-21, 2013 Duration: 17 Sept 2013 → …

Workshop

Workshop	Proceedings of the 2nd Workshop on Technology Enhanced Formative Assessment co-located with EC-TEL 2013, the 8th European Conference on Technology Enhanced Learning
Period	17/09/13 → …

Keywords

e-learning
Item Pool Optimization
Computer Aided Assessment
Item Analysis
Massive Open Online Courses
MOOCs
Item Response Theory
Learning Management Systems
Technology Enhanced Learning

Access to Document

paper3.pdfAccepted author manuscript, 870 KBLicence: Unspecified

http://ceur-ws.org/Vol-1147/paper3.pdfLicence: Unspecified

Cite this

@inproceedings{6dde8afa82774bfb9cadf4b5cd098893,

title = "Integrating IRT Analysis into LMS for Item Pool Optimization",

abstract = "Due to the computerization of assessment tests, the use of Item Re- sponse Theory (IRT) has become commonplace for educational assessment de- velopment, evaluation, and refinement. When used appropriately by a Learning Management System (LMS), IRT can improve the assessment quality, increase the efficiency of the testing process, and provide in-depth descriptions of item and test properties. This paper introduces a methodological and architectural framework which embeds an IRT analysis tool in an LMS so as to extend its functionality with assessment optimization support. By applying a set of validi- ty rules to the statistical indices produced by the IRT analysis, the enhanced LMS is able to detect several defective items from an item pool which are then reported for reviewing of their content. Assessment refinement is achieved by repeatedly employing this process until all flawed items are eliminated.",

keywords = "e-learning, Item Pool Optimization, Computer Aided Assessment, Item Analysis, Massive Open Online Courses, MOOCs, Item Response Theory, Learning Management Systems, Technology Enhanced Learning",

author = "Panagiotis Fotaris and Theodoros Mastoras",

year = "2013",

month = sep,

day = "17",

language = "English",

volume = "1147",

pages = "0--0",

booktitle = "Proceedings of the 2nd Workshop on Technology Enhanced Formative Assessment co-located with EC-TEL 2013, the 8th European Conference on Technology Enhanced Learning",

publisher = "CEUR-WS.org",

note = "Proceedings of the 2nd Workshop on Technology Enhanced Formative Assessment co-located with EC-TEL 2013, the 8th European Conference on Technology Enhanced Learning ; Conference date: 17-09-2013",

}

Fotaris, P & Mastoras, T 2013, Integrating IRT Analysis into LMS for Item Pool Optimization. in Proceedings of the 2nd Workshop on Technology Enhanced Formative Assessment co-located with EC-TEL 2013, the 8th European Conference on Technology Enhanced Learning. vol. 1147, CEUR-WS.org, Paphos, Cyprus, pp. 0-0, Proceedings of the 2nd Workshop on Technology Enhanced Formative Assessment co-located with EC-TEL 2013, the 8th European Conference on Technology Enhanced Learning, 17/09/13. <http://ceur-ws.org/Vol-1147/paper3.pdf>

Integrating IRT Analysis into LMS for Item Pool Optimization. / Fotaris, Panagiotis; Mastoras, Theodoros.
Proceedings of the 2nd Workshop on Technology Enhanced Formative Assessment co-located with EC-TEL 2013, the 8th European Conference on Technology Enhanced Learning. Vol. 1147 Paphos, Cyprus: CEUR-WS.org, 2013. p. 0-0.

Research output: Chapter in Book/Conference proceeding with ISSN or ISBN › Conference contribution with ISSN or ISBN › peer-review

TY - GEN

T1 - Integrating IRT Analysis into LMS for Item Pool Optimization

AU - Fotaris, Panagiotis

AU - Mastoras, Theodoros

PY - 2013/9/17

Y1 - 2013/9/17

N2 - Due to the computerization of assessment tests, the use of Item Re- sponse Theory (IRT) has become commonplace for educational assessment de- velopment, evaluation, and refinement. When used appropriately by a Learning Management System (LMS), IRT can improve the assessment quality, increase the efficiency of the testing process, and provide in-depth descriptions of item and test properties. This paper introduces a methodological and architectural framework which embeds an IRT analysis tool in an LMS so as to extend its functionality with assessment optimization support. By applying a set of validi- ty rules to the statistical indices produced by the IRT analysis, the enhanced LMS is able to detect several defective items from an item pool which are then reported for reviewing of their content. Assessment refinement is achieved by repeatedly employing this process until all flawed items are eliminated.

AB - Due to the computerization of assessment tests, the use of Item Re- sponse Theory (IRT) has become commonplace for educational assessment de- velopment, evaluation, and refinement. When used appropriately by a Learning Management System (LMS), IRT can improve the assessment quality, increase the efficiency of the testing process, and provide in-depth descriptions of item and test properties. This paper introduces a methodological and architectural framework which embeds an IRT analysis tool in an LMS so as to extend its functionality with assessment optimization support. By applying a set of validi- ty rules to the statistical indices produced by the IRT analysis, the enhanced LMS is able to detect several defective items from an item pool which are then reported for reviewing of their content. Assessment refinement is achieved by repeatedly employing this process until all flawed items are eliminated.

KW - e-learning

KW - Item Pool Optimization

KW - Computer Aided Assessment

KW - Item Analysis

KW - Massive Open Online Courses

KW - MOOCs

KW - Item Response Theory

KW - Learning Management Systems

KW - Technology Enhanced Learning

M3 - Conference contribution with ISSN or ISBN

VL - 1147

SP - 0

EP - 0

BT - Proceedings of the 2nd Workshop on Technology Enhanced Formative Assessment co-located with EC-TEL 2013, the 8th European Conference on Technology Enhanced Learning

PB - CEUR-WS.org

CY - Paphos, Cyprus

T2 - Proceedings of the 2nd Workshop on Technology Enhanced Formative Assessment co-located with EC-TEL 2013, the 8th European Conference on Technology Enhanced Learning

Y2 - 17 September 2013

ER -

Integrating IRT Analysis into LMS for Item Pool Optimization

Abstract

Workshop

Keywords

Access to Document

Fingerprint

Cite this