A Systematic Analysis and Synthesis of the Empirical MOOC Literature Published in 2013–2015
ARTICLE
George Veletsianos, Royal Roads University ; Peter Shepherdson
IRRODL Volume 17, Number 2, ISSN 1492-3831 Publisher: Athabasca University Press
Abstract
A deluge of empirical research became available on MOOCs in 2013–2015 and this research is available in disparate sources. This paper addresses a number of gaps in the scholarly understanding of MOOCs and presents a comprehensive picture of the literature by examining the geographic distribution, publication outlets, citations, data collection and analysis methods, and research strands of empirical research focusing on MOOCs during this time period. Results demonstrate that (a) more than 80% of this literature is published by individuals whose home institutions are in North America and Europe, (b) a select few papers are widely cited while nearly half of the papers are cited zero times, and (c) researchers have favored a quantitative if not positivist approach to the conduct of MOOC research, preferring the collection of data via surveys and automated methods. While some interpretive research was conducted on MOOCs in this time period, it was often basic and it was the minority of studies that were informed by methods traditionally associated with qualitative research (e.g., interviews, observations, and focus groups). Analysis shows that there is limited research reported on instructor-related topics, and that even though researchers have attempted to identify and classify learners into various groupings, very little research examines the experiences of learner subpopulations.
Citation
Veletsianos, G. & Shepherdson, P. (2016). A Systematic Analysis and Synthesis of the Empirical MOOC Literature Published in 2013–2015. The International Review of Research in Open and Distributed Learning, 17(2),. Athabasca University Press. Retrieved August 10, 2024 from https://www.learntechlib.org/p/172554/.
Keywords
References
View References & Citations Map- Admiraal, W., Huisman, B., & Van de Ven, M. (2014). Self-and peer assessment in Massive Open Online Courses. International Journal of Higher Education, 3(3), 119–128.
- Alario-Hoyos, C., Pérez-Sanagustín, M., Delgado-Kloos, C., Parada, G. & Munoz-Organero, M. (2014). Delving into participants’ profiles and use of social tools in MOOCs. IEEE Transactions on Learning Technologies, (3), 260–266.
- Bates, T. (2014). MOOCs: Getting to know you better. Distance Education, 35(2), 145–148.
- Bayne, S. (2015). Teacherbot: Interventions in automated teaching. Teaching in Higher Education, 20(4), 455-467.
- Bayne, S., & Ross, J. (2014). The pedagogy of the Massive Open Online Course: The UK view. York, UK: The Higher Education Academy.
- Biesta, G. (2011). Disciplines and theory in the academic study of education: A comparative analysis of the Anglo-American and Continental construction of the field. Pedagogy, Culture & Society, 19(2), 175-192.
- Breslow, L., Pritchard, D.E., DeBoer, J., Stump, G.S., Ho, A.D., & Seaton, D.T. (2013). Studying learning in the worldwide classroom: Research into edX's first MOOC. Research and Practice in Assessment, 8, 13-25.
- Bulfin, S., Pangrazio, L., & Selwyn, N. (2014). Making “MOOCs”: The construction of a new digital higher education within news media discourse. International Review of Research in Open and Distributed Learning, 15(5), 290–305.
- Cisel, M., Bachelet, R., & Bruillard, E. (2013). Peer assessment in the first French MOOC: Analyzing assessors’ behavior. In Proceedings of the 7th International Conference on Educational Data Mining (pp. 403–404). London, UK: International Educational Data
- Ebben, M., & Murphy, J.S. (2014). Unpacking MOOC scholarly discourse: A review of nascent MOOC scholarship. Learning, Media and Technology, 39(3), 328–345.
- Gao, F., Luo, T., & Zhang, K. (2012). Tweeting for learning: A critical analysis of research on micro-blogging in education published 2008–2011. British Journal of Educational Technology, 43(5), 783–801.
- Gasevic, D., Kovanovic, V., Joksimovic, S., & Siemens, G. (2014). Where is research on massive open online courses headed? A data analysis of the MOOC Research Initiative. The
- Guo, P.J., Kim, J., & Rubin, R. (2014). How video production affects student engagement: An empirical study of MOOC videos. In Proceedings of the first ACM conference on Learning @ scale conference: L@S ’14 (pp. 41–50). New York, NY: ACM.
- Hew, K.F., & Cheung, W.S. (2014). Students’ and instructors' use of massive open online courses (MOOCs): Motivations and challenges. Educational Research Review, 12, 45.
- Hollands, F.M., & Tirthali, D. (2014). Resource requirements and costs of developing and delivering MOOCs. International Review of Research in Open and Distributed Learning, 15(5), 113-133.
- Huang, J., Dasgupta, A., Ghosh, A., Manning, J., & Sanders, M. (2014). Superposter behavior in MOOC forums. In Proceedings of the first ACM conference on Learning @ scale conference—L@S ’14 (pp. 117–126). Atlanta, Georgia, USA: ACM Press.
- Jacoby, J. (2014). The disruptive potential of the massive open online course: A literature review. Journal of Open, Flexible and Distance Learning, 18(1), 73-85.
- Jona, K., & Naidu, S. (2014). MOOCs: Emerging research. Distance Education, 35(2), 141–144.
- Jordan, K. (2014). Initial trends in enrolment and completion of massive open online courses. International Review of Research in Open and Distributed Learning, 15(1), 133–160.
- Kellogg, S., Booth, S., & Oliver, K. (2014). A social network perspective on peer supported learning in MOOCs for educators. International Review of Research in Open and Distributed Learning, 15(5).
- Kennedy, J. (2014). Characteristics of massive open online courses (MOOCs): A research review, 2009–2012. Journal of Interactive Online Learning, 13(1), 1–16.
- Khalil, H., & Ebner, M. (2013). “How satisfied are you with your MOOC?”-A research study on interaction in huge online courses. In Proceedings of the World Conference on
- Kim, J., Guo, P.J., Seaton, D.T., Mitros, P., Gajos, K.Z., & Miller, R.C. (2014). Understanding invideo dropouts and interaction peaks in online lecture videos. In Proceedings of the first ACM conference on Learning @ scale conference—L@S ’14 (pp. 31–40). New York, NY:
- Kovanović, V., Joksimović, S., Gašević, D., Siemens, G., & Hatala, M. (2015), What public media reveals about MOOCs: A systematic analysis of news reports. British Journal of Educational Technology, 46(3), 510–527.
- Liyanagunawardena, T.R., Adams, A.A., & Williams, S.A. (2013). MOOCs: A systematic study of the published literature 2008–2012. The International Review of Research in Open and Distributed Learning, 14(3), 202–227.
- Merriam, S. (2002). Qualitative research in practice: Examples for discussion and analysis. San Francisco, CA: Jossey-Bass.
- O’Connor, K. (2014). MOOCs, institutional policy and change dynamics in higher education. Higher Education, 68(5), 623–635. Perkins, R., & Lowenthal, P.R. (in press). Open access journals in educational technology: results of a survey of experienced users. Australasian Journal of Educational Technology.
- Perna, L.W., Ruby, A., Boruch, R.F., Wang, N., Scull, J., Ahmad, S., & Evans, C. (2014). Moving through MOOCs: Understanding the progression of users in massive open online courses. Educational Researcher, 43(9), 421–432.
- Radford, A.W., Robles, J., Cataylo, S., Horn, L., Thornton, J., & Whitfield, K.E. (2014). The employer potential of MOOCs: A mixed-methods study of human resource professionals’ thinking on MOOCs. International Review of Research in Open and Distributed Learning, 15(5), 1–25.
- Reich, J. (2014, December 10). MOOC completion and retention in the context of student intent. EDUCAUSE Review. Retrieved from http://er.educause.edu/ero
- Reich, J. (2015). Rebooting MOOC research. Science, 347(6217), 34–35.
- Rodriguez, O. (2012). MOOCs and the AI-Stanford like courses: Two successful and distinct course formats for Massive Open Online Courses. European Journal of Open, Distance, and E-Learning. Retrieved from http://www.eurodl.org/materials/contrib/2012/Rodriguez.pdf
- Sæbø, Ø., Rose, J., & Flak, L.S. (2008). The shape of eParticipation: Characterizing an emerging research area. Government Information Quarterly, 25(3), 400–428.
- SCImago. (2007). SJR: SCImago journal & Country rank. Retrieved June 08, 2015, from http://www.scimagojr.com/countryrank.php
- Selwyn, N., Bulfin, S., & Pangrazio, L. (2015). Massive open online change? Exploring the discursive construction of the ‘MOOC’ in newspapers. Higher Education Quarterly, 69(2), 175-192.
- Sheard, J., Eckerdal, A., Kinnunen, P., Malmi, L., Nylén, A., & Thota, N. (2014). MOOCs and their impact on academics. In Proceedings of the 14th Koli Calling International Conference on Computing Education Research (pp. 137–145). New York, NY: ACM.
- Singer, S. (2014). Learning about learning in a technology-enabled world. Keynote presentation at the meeting of Learning with MOOCs: A Practitioner’s Workshop. Retrieved from http://www.moocworkshop.org/wpcontent/uploads/2014/08/Singer_Learning_MOOC_Boston_8-12-14.pdf
- Smeyers, P., & Burbules, N.C. (2011). How to improve your impact factor: Questioning the quantification of academic quality. Journal of Philosophy of Education, 45(1), 1–17.
- Sparks, S., & House, L. (2005). JISC disciplinary differences report. London, UK: Joint Information Systems Committee (JISC).
- Stanton, J.M., & Harkness, S.S.J. (2014). Got MOOC? Labor costs for the development and delivery of an open online course. Information Resources Management Journal, 27(2),
- Stephens-Martinez, K., Hearst, M.A., & Fox, A. (2014). Monitoring MOOCs : Which information sources do instructors value ? In Proceedings of the first ACM conference on Learning @ scale conference—L@S ’14 (pp. 79–88). Atlanta, GA: ACM Press.
- Subhi, Y., Andresen, K., Rolskov Bojsen, S., Mørkeberg Nilsson, P., & Konge, L. (2014). Massive open online courses are relevant for postgraduate medical training. Danish Medical Journal, 61(10), A4923.
- Tashakkori, A., & Teddlie, C. (2003). Handbook on mixed methods in the behavioral and social sciences. Thousand Oaks, CA: Sage.
- Togia, A., & Tsigilis, N. (2006). Impact factor and education journals: A critical examination and analysis. International Journal of Educational Research, 45(6), 362–379.
- Veletsianos, G., Collier, A., & Schneider, E. (2015). Digging deeper into learners' experiences in MOOCs: Participation in social networks outside of MOOCs, notetaking, and contexts surrounding content consumption. British Journal of Educational Technology, 46(3), 570–587.
- Veletsianos, G., & Shepherdson, P. (2015). Who studies MOOCs? Interdisciplinarity in MOOC research and its changes over time. International Review of Research in Open and Distributed Learning, 16(3). Retrieved from http://www.irrodl.org/index.php/irrodl/article/view/2202
- Wang, Y., Paquette, L., & Baker, R. (2014). A longitudinal study on learner career advancement in MOOCs. Journal of Learning Analytics, 1(3), 203–206.
- Yang, D., Piergallini, M., Howley, I., & Rose, C. (2014). Forum thread recommendation for massive open online courses. In Proceedings of the 7th International Conference on Educational Data Mining (pp. 257–260). London, UK: International Educational Data
These references have been extracted automatically and may have some errors. Signed in users can suggest corrections to these mistakes.
Suggest Corrections to ReferencesCited By
View References & Citations Map-
Characterization of the Reasons Why Brazilian Science Teachers Drop Out of Online Professional Development Courses
Maurício Luz, Laboratório de Avaliação em Ensino e Filosofia das Biociências - Instituto Oswaldo Cruz; Luiz Rolando, Laboratório de Avaliação em Ensino e Filosofia das Biociências - Instituto Oswaldo Cruz Fundação Cecierj; Daniel Salvador, Fundação Cecierj; André Sousa, Laboratório de Avaliação em Ensino e Filosofia das Biociências - Instituto Oswaldo Cruz
The International Review of Research in Open and Distributed Learning Vol. 19, No. 5 (Nov 27, 2018)
-
Analysing Structured Learning Behaviour in Massive Open Online Courses (MOOCs): An Approach Based on Process Mining and Clustering
Antoine van den Beemt, Eindhoven School of Education, Eindhoven University of Technology, The Netherlands; Joos Buijs, Eindhoven University of Technology; Wil van der Aalst, RWTH Aachen University, Germany
The International Review of Research in Open and Distributed Learning Vol. 19, No. 5 (Nov 27, 2018)
-
How do Virtual Teams Collaborate in Online Learning Tasks in a MOOC?
Daniëlle Verstegen, Maastricht University, School of Health Professions Education; Amber Dailey-Hebert, Herco Fonteijn, Geraldine Clarebout & Annemarie Spruijt
The International Review of Research in Open and Distributed Learning Vol. 19, No. 4 (Sep 26, 2018)
-
Troubleshooters for Tasks of Introductory Programming MOOCs
Marina Lepp, University of Tartu; Tauno Palts, Piret Luik, Kaspar Papli, Reelika Suviste, Merilin Säde, Kaspar Hollo, Vello Vaherpuu & Eno Tõnisson
The International Review of Research in Open and Distributed Learning Vol. 19, No. 4 (Sep 26, 2018)
-
Decision, Implementation, and Confirmation: Experiences of Instructors behind Tourism and Hospitality MOOCs
Jingjing Lin, USI Università della Svizzera italiana; Lorenzo Cantoni, Faculty of Communication Sciences, USI Università della Svizzera italiana
The International Review of Research in Open and Distributed Learning Vol. 19, No. 1 (Feb 23, 2018)
-
Teaching Massive, Open, Online, Courses (MOOCs): Tales from the Front Line
Patrick Lowenthal, Chareen Snelson & Ross Perkins, Boise State University
The International Review of Research in Open and Distributed Learning Vol. 19, No. 3 (Jul 11, 2018)
-
Learning from decades of online distance education: MOOCs and the Community of Inquiry framework
Dodzi Amemado & Stefania Manca
Journal of e-Learning and Knowledge Society Vol. 13, No. 2 (May 29, 2017)
-
A Systematic Review of MOOC Research Methods and Topics: Comparing 2014-2016 and 2016-2017
Meina Zhu, Annisa Sari & Curtis Bonk, Indiana University, United States
EdMedia + Innovate Learning 2018 (Jun 25, 2018) pp. 1673–1682
-
Promise and Parameters: Digital Badges for Ongoing Professional Learning
Mark Hofer, College of William and Mary, United States; Jessica Duggan & Todd Moellendick, College of William & Mary, United States
Society for Information Technology & Teacher Education International Conference 2018 (Mar 26, 2018) pp. 171–179
-
What Research Says About MOOCs – An Explorative Content Analysis
Olaf Zawacki-Richter, Carl von Ossietzky University of Oldenburg; Aras Bozkurt, Anadolu University; Uthman Alturki & Ahmed Aldraiweesh, King Saud University
The International Review of Research in Open and Distributed Learning Vol. 19, No. 1 (Feb 23, 2018)
-
Instructor Experiences in Designing and Delivering Interactive MOOCs in Higher Education
Meina Zhu, Curtis J. Bonk & Annisa Sari, Indiana University, United States
E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education 2017 (Oct 17, 2017) pp. 509–515
-
Massive, Open, Online, and National? A Study of How National Governments and Institutions Shape the Development of MOOCs
Cathrine Tmte, Nordic Institute for Studies in Innovation, Research and Education, NIFU; Arne Fevolden, Centre for Technology, Innovation and Culture (TIK) University of Oslo and The Nordic Institute for Studies in Innovation, Research and Education (NIFU).; Siri Aanstad, Nordic Institute for Studies in Innovation, Research and Education, NIFU
The International Review of Research in Open and Distributed Learning Vol. 18, No. 5 (Aug 15, 2017)
-
Nonnative English-Speaking Students’ Lived Learning Experiences With MOOCs in a Regular College Classroom
Moon-Heum Cho & Moon-Kyoung Byun, Sungkyunkwan University
The International Review of Research in Open and Distributed Learning Vol. 18, No. 5 (Aug 15, 2017)
-
Understanding Learners’ Motivation and Learning Strategies in MOOCs
Carlos Alario-Hoyos & Iria Estvez-Ayres, Universidad Carlos III de Madrid; Mar Prez-Sanagustn, Pontificia Universidad Catlica de Chile, Santiago, Chile; Carlos Delgado Kloos & Carmen Fernndez-Panadero, Universidad Carlos III de Madrid
The International Review of Research in Open and Distributed Learning Vol. 18, No. 3 (May 12, 2017)
These links are based on references which have been extracted automatically and may have some errors. If you see a mistake, please contact info@learntechlib.org.