A Test Sheet Optimization Approach to Supporting Web-based Learning Diagnosis Using Group Testing Methods
ARTICLE
Chu-Fu Wang, Chih-Lung Lin, National Pingtung University, Department of Computer Science, Pingtung, Taiwan ; Gwo-Jen Hwang, National Taiwan University of Science and Technology, Graduate Institute of Digital Learning and Education, Taipei City, Taiwan ; Sheng-Pin Kung, National Pingtung University, Department of Computer Science, Pingtung, Taiwan ; Shin-Feng Chen, National Pingtung University, Department of Education, Pingtung, Taiwan
IJOPCD Volume 7, Number 4, ISSN 2155-6873 Publisher: IGI Global
Abstract
Assessment can help teachers to examine the effectiveness of teaching and to diagnose the unfamiliar basic concepts (or attributes) of students within the testing scope. A web-based adaptive testing and diagnostic system can achieve the above objective efficiently and correctly. From a diagnostic point of view, the major concerns are to diagnose whether or not an examinee has learned each basic concept well in the testing scope, while also limiting the number of test items used (the testing length) to as few as possible, which will be directly related to the patience of the examinee. In this paper, we consider a test item selecting optimization diagnostic problem to reveal the mastery profile of an examinee (that is, to diagnose each basic concept's learning status (well learned/unfamiliar) in the testing scope) with a short testing length and a limited test item exposure rate. This paper uses the techniques of Group Testing theory for the design of our test item selecting algorithm. Two test item selecting strategies, the bisecting method and the doubling method, are proposed. The effectiveness of the proposed methods was evaluated by experimental simulations. The results show that both of the proposed algorithms use fewer test items and a limited test item exposure rate compared to the conventional methods.
Citation
Wang, C.F., Lin, C.L., Hwang, G.J., Kung, S.P. & Chen, S.F. (2017). A Test Sheet Optimization Approach to Supporting Web-based Learning Diagnosis Using Group Testing Methods. International Journal of Online Pedagogy and Course Design, 7(4), 1-23. IGI Global. Retrieved March 19, 2024 from https://www.learntechlib.org/p/187133/.
Keywords
References
View References & Citations Map- Aarts, E., & Lenstra, J.K. (1997). Local Search in Combinatorial Optimization. John-Wiley& Sons Ltd.
- Barrada, J.R., Olea, J., & Ponsoda, V. (2007). Methods for restricting maximum exposure rate in computerized adaptive testing. Methodology, 3(1), 14–23.
- Bilder, C.R. (2005, August). Group testing model estimation and inference (Contributed poster). Proceedings of the 2005 Joint Statistical Meetings, Minneapolis, USA.
- Bilder, C.R., & Tebbs, J.M. (2004, August). Empirical Bayesian estimation of the disease transmission probability in multiple-vector-transfer designs (Contributed poster). Proceedings of the 2004 Joint Statistical Meetings, Toronto, USA.
- Chang, H.H., Qian, J., & Ying, Z. (2001). A-stratified multistage computerized adaptive testing with b blocking. Applied Psychological Measurement, 25(4), 333–341. Doi:10.1177/01466210122032181
- Chang, H.H., & Ying, Z. (1999). A-stratified multistage computerized adaptive testing. Applied Psychological Measurement, 23(3), 211–222. Doi:10.1177/01466219922031338
- Cheng, S.C., Lin, Y.T., & Huang, Y.M. (1999). Dynamic question generation system for web-based testing using particle swarm optimization. Expert Systems with Applications, 36(1), 616–624.
- Dorfman, R. (1943). The detection of defective members of large population. Annals of Mathematical Statistics, 14(4), 436–440.
- Hartz, S. (2002). A bayesian framework for the unified model for assessing cognitive abilities: blending theory with practice. Unpublished doctoral thesis, University of Illinois at Urbana-Champaign.
- Huang, A., Li, D., Hou, J., & Bi, T. (2015). An adaptive cellular genetic algorithm based on selection strategy for test sheet generation. International Journal of Hybrid Information Technology, 8(9), 33–42.
- Hwang, G.J. (2003). A conceptual map model for developing intelligent tutoring systems. Computers& Education, 40(3), 217–235. Doi:10.1016/S0360-1315(02)00121-5
- Hwang, G.J., Chu, H.C., Yin, P.Y., & Lin, J.Y. (2008). An innovative parallel test sheet composition approach to meet multiple assessment criteria for national tests. Computers& Education, 51(3), 1058–1072. Doi:10.1016/J.Compedu.2007.10.006
- Hwang, G.J., Lin, B.M.T., Tseng, H.H., & Lin, T.L. (2005). On the development of a computer-assisted testing system with genetic test sheet-generating approach. IEEE Transactions on Systems, Man, and Cybernetics, Part C. Applications and Review, 35(4), 590–594.
- Hwang, G.J., Panjaburee, P., Triampo, W., & Shih, B.Y. (2013). A group decision approach to developing concept-effect models for diagnosing student learning problems in mathematics. British Journal of Educational Technology, 44(3), 453–468.
- Hwang, G.J., Yin, P.Y., & Yeh, S.H. (2006). A tabu search approach to generating test sheets for multiple assessment criteria. IEEE Transactions on Education, 49(1), 88–97.
- Kennedy, J., & Eberhart, R.C. (1995). Particle swarm optimization. Paper presented at the IEEE International Conference on Neural Networks, Perth, Australia.
- Kim, B.W., & Shon, J.G. (2015). Test-sheet composition using genetic algorithm for controlling item exposure. In Computer Science and its Applications (pp. 1077–1083). Springer Berlin Heidelberg.
- Linden, W.J. (2005). Linear Models for Optimal Test Design. Springer-Verlag.
- Lord, F.M. (1980). Applications of Item Response Theory to Practical Testing Problems. Hillsdale, New Jersey: Lawrence Erlbaum Associates, Publishers.
- Lord, F.M., & Novick, M.R. (1968). Statistical Theories of Mental Test Scores. Addison-Wesley Publishing Company, Inc. International Journal of Online Pedagogy and Course Design Volume 7 • Issue 4 • October-December 2017
- Michalewicz, Z., & Fogel, D.B. (2002). How to Solve It: Modern Heuristics. Springer-Verlag.
- Singh, S.K., & Tiwari, A.K. (2016). Design and implementation of secure computer based examination system based on b/s structure. International Journal of Applied Engineering Research, 11(1), 312–318.
- Weissman, A. (2007). Mutual information item selection in adaptive classification testing. Educational and Psychological Measurement, 67(1), 41–58. Doi:10.1177/0013164406288164
- Xu, X., Chang, H., & Douglas, J. (2003). Computerized adaptive testing strategies for cognitive diagnosis. Paper presented at the annual meeting of National Council on Measurement in Education, Chicago, IL.
- Yin, P.Y., Chang, K.C., Hwang, G.J., Hwang, G.H., & Chan, Y. (2006). A particle swarm optimization approach to composing serial test sheets for multiple assessment criteria. Journal of Educational Technology& Society, 9(3), 3–15.
These references have been extracted automatically and may have some errors. Signed in users can suggest corrections to these mistakes.
Suggest Corrections to References