Performance Assessment in Serious Games: Compensating for the Effects of Randomness
Education and Information Technologies Volume 21, Number 3, ISSN 1360-2357
This paper is about performance assessment in serious games. We conceive serious gaming as a process of player-lead decision taking. Starting from combinatorics and item-response theory we provide an analytical model that makes explicit to what extent observed player performances (decisions) are blurred by chance processes (guessing behaviors). We found large effects both theoretically and practically. In two existing serious games random guess scores were found to explain up to 41 of total scores. Monte Carlo simulation of random game play confirmed the substantial impact of randomness on performance. For valid performance assessments, be it in-game or post-game, the effects of randomness should be included to produce re-calibrated scores that can reasonably be interpreted as the players' achievements.
Westera, W. (2016). Performance Assessment in Serious Games: Compensating for the Effects of Randomness. Education and Information Technologies, 21(3), 681-697.
Cited ByView References & Citations Map
Serious Games: Learner Assessment in Serious Game Design, a Framework for Assessment Metric Identification and Integration in the Game Mechanic
Ilenius Ildephonce, Department of Computing - University of West Indies, Mona., Jamaica; Ezra Mugisa & Claudine Allen, Department of Computing - University of West Indies, Mona, Jamaica
E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education 2015 (Oct 19, 2015) pp. 1115–1121
These links are based on references which have been extracted automatically and may have some errors. If you see a mistake, please contact email@example.com.