You are here:

The IRAC framework: Locating the performance zone for learning analytics

, University of Southern Queensland ; , , CQ University

ASCILITE - Australian Society for Computers in Learning in Tertiary Education Annual Conference, ISBN 978-1-74138-403-1 Publisher: Australasian Society for Computers in Learning in Tertiary Education


It is an unusual Australian University that is not currently expending time and resources in an attempt to harness learning analytics. This rush, like prior management fads, is likely to face significant challenges when it comes to adoption, let alone the more difficult challenge of translating possible insights from learning analytics into action that improves learning and teaching. This paper draws on a range of prior research to develop four questions – the IRAC framework - that can be used to improve the analysis and design of learning analytics tools and interventions. Use of the IRAC framework is illustrated through the analysis of three learning analytics tools currently under development. This analysis highlights how learning analytics projects tend to focus on limited understandings of only some aspects of the IRAC framework and suggests that this will limit its potential impact.


Jones, D., Beer, C. & Clark, D. (2013). The IRAC framework: Locating the performance zone for learning analytics. In Proceedings of Electric Dreams. Proceedings ascilite 2013 Sydney (pp. 446-450). Australasian Society for Computers in Learning in Tertiary Education. Retrieved March 19, 2019 from .


View References & Citations Map


  1. Arnott, D., & Pervan, G. (2005). A critical analysis of decision support systems research. Journal of Information Technology, 20(2), 67–87.
  2. Beer, C., Jones, D., & Clark, D. (2012). Analytics and complexity: Learning and leading for the future. In M. Brown, M. Hartnett, & T. Stewart (Eds.), Future Challenges, Sustainable Futures. Proceedings of ascilite Wellington 2012 (pp. 78–87). Wellington, NZ.
  3. Boland, R.J. (2002). Design in the punctuation of management action. In R. Boland & F. Collopy (Eds.), Managing as designing (pp. 106–112). Standford, CA: Standford University Press.
  4. Bollier, D., & Firestone, C. (2010). The promise and peril of big data. Washington DC: The Aspen Institute. Boustani, M.A, Munger, S., Gulati, R., Vogel, M., Beck, R.A, & Callahan, C.M. (2010). Selecting a change and evaluating its impact on the performance of a complex adaptive healthcare delivery system. Clinical interventions in aging, 5, 141–8.
  5. Buckingham Shum, S. (2012). Learning Analytics. Moscow.
  6. Dickelman, G. (1995). Things That Help Us Perform: Commentary on Ideas from Donald A. Norman. Performance improvement quarterly, 8(1), 23–30.
  7. Elias, T. (2011). Learning Analytics: Definitions, Processes and Potential. Learning.
  8. Essa, A., & Ayad, H. (2012). Student success system: risk analytics and data visualization using ensembles of predictive models. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge-LAK’12 (pp. 2–5). Vancouver: ACM Press.
  9. Gery, G.J. (1991). Electronic Performance Support Systems: How and why to remake the workplace through the strategic adoption of technology. Tolland, MA: Gery Performance Press.
  10. Glassey, K. (1998). Seducing the End User. Communications of the ACM, 41(9), 62–69.
  11. Goodhue, D., & Thompson, R. (1995). Task-technology fit and individual performance. MIS quarterly, 19(2), 213.
  12. Hannafin, M., McCarthy, J., Hannafin, K., & Radtke, P. (2001). Scaffolding performance in EPSSs: Bridging theory and practice. In World Conference on Educational Multimedia, Hypermedia and Telecommunications (pp. 658–663).
  13. Hevner, A., March, S., Park, J., & Ram, S. (2004). Design science in information systems research. MIS Quarterly, 28(1), 75–105.
  14. Johnson, L., Adams Becker, S., Cummins, M., Freeman, A., Ifenthaler, D., & Vardaxis, N. (2013). Technology Outlook for Australian Tertiary Education 2013-2018: An NMC Horizon Project Regional Analysis. Austin, Texas.
  15. Johnson, L., Adams, S., & Cummins, M. (2012). Technology Outlook for Australian Tertiary Education 2012-2017: An NMC Horizon Report Regional Analysis. New Media Consortium. Austin, Texas.
  16. Johnson, L., Smith, R., Levine, A., & Haywood, K. (2010). The horizon report: 2010 Australia-New Zealand Edition. Austin, Texas.
  17. Lockyer, L., Heathcote, E., & Dawson, S. (2013). Informing Pedagogical Action: Aligning Learning Analytics With Learning Design. American Behavioral Scientist, XX(X), 57(10), 1439-1459.
  18. Lodge, J., & Lewis, M. (2012). Pigeon pecks and mouse clicks: Putting the learning back into learning analytics. In M. Brown, M. Hartnett, & T. Stewart (Eds.), Future challenges, sustainable futures. Proceedings ascilite Wellington 2012 (pp. 560–564). Wellington, NZ.
  19. Olmos, M., & Corrin, L. (2012). Learning analytics: a case study of the process of design of visualizations. Journal of Asynchronous Learning Networks, 16(3), 39–49.
  20. Reiser, R. (2001). A history of instructional design and technology: Part II: A history of instructional design. Educational Technology Research and Development, 49(2), 57–67.
  21. Siemens, G., & Long, P. (2011). Penetrating the Fog: Analytics in Learning and Education. EDUCAUSE Review, 46(5).
  22. Swanson, E.B., & Ramiller, N.C. (2004). Innovating mindfully with information technology. MIS Quarterly, 28(4), 553–583.
  23. Tutty, J., Sheard, J., & Avram, C. (2008). Teaching in the current higher education environment: perceptions of IT academics. Computer Science Education, 18(3), 171–185.
  24. Villachica, S., Stone, D., & Endicott, J. (2006). Performance Suport Systems. In J. Pershing (Ed.), Handbook of Human Performance Technology (Third Edit., pp. 539–566). San Francisco, CA: John Wiley& Sons.
  25. Young, M.F., Barab, S.A., & Garrett, S. (2000). Agent as detector: An ecological psychology perspective on learning by perceiving-acting systems. In D. Jonassen& S. Land (Eds.), Theoretical foundations of learning environments (pp. 143–173). Mahwah, New Jersey: Lawrence Erlbaum Associates.

These references have been extracted automatically and may have some errors. If you see a mistake in the references above, please contact