You are here:

Evaluating CSL/CFL Website Usability: A User-centered Design Approach

, , University of Texas at Austin, United States ; , National Taiwan Normal University, Taiwan

Journal of Educational Multimedia and Hypermedia Volume 19, Number 2, ISSN 1055-8896 Publisher: Association for the Advancement of Computing in Education (AACE), Waynesville, NC USA


With the widespread availability of Internet and computer technology, on-line web-based learning has become prevalent in the field of teaching Chinese as a second/foreign language (CSL/CFL). This study examined the concepts of usability and types of design elements that help construct an effective web-based learning environment, as well as
their relationship with user perspectives from both CSL/CFL learners and teachers. The participants’ navigation experiences were
investigated as they performed and reflected upon the guided usability tasks on assigned websites via a semi-structured think-aloud
interview. Captivate and Audacity software were used purposively to capture users’ navigation paths and record reflections during each test section. The findings provide a profile of design issues and
examples in terms of interface, information and interaction along with pedagogical suggestions to consider in future CSL/CFL website design
and development.


Huang, C.K., Hsin, C.O. & Chiu, C.H. (2010). Evaluating CSL/CFL Website Usability: A User-centered Design Approach. Journal of Educational Multimedia and Hypermedia, 19(2), 177-210. Waynesville, NC USA: Association for the Advancement of Computing in Education (AACE). Retrieved March 22, 2019 from .


View References & Citations Map


  1. Barnum, M.C. (2002). Usability testing and research. New York: Longman.
  2. BBC News. (2007, January 9). Mandarin learning soars outside China. BBC News. Retrieved from Beijing Language and Culture University. (2008). Introduction to the HSK. Retrieved March 10, 2010, from
  3. Bevan, N. (2009). International standards for usability should be more widely used. Journal of Usability Studies, 4(3), 106-113.
  4. Chang, L.-P. (2007). 華語文能力測驗發展現況 [The current development of Test of Proficiency—Huayu]. Retrieved May 21, 2010, from
  5. Chen, H.-Y., & Liu, K.-Y. (2008). Web-based synchronized multimedia lecture system design for teaching/learning Chinese as second language. Computers& Education, 50(3), 693-702. Doi:10.1016/J.compedu.2006.07.010.
  6. Chiu, C.-H. (2008). ActiveChinese: Chinese language skills for the business world. Language Learning& Technology, 12(3), 23-32. Retrieved from
  7. College Entrance Examination Board. (2009). AP Chinese language and culture. Retrieved September 30, 2009, from
  8. Downey, L.L. (2007). Group usability testing: Evolution in usability techniques. Journal of Usability Studies 2(3), 133-144.
  9. Dumas, S.J., & Redish, C.J. (1999). A practical guide to usability testing (Rev. Ed.). Portland, Oregon: Intellect Books. ESchool News. (2006, January 13). Tech fosters Chinese language learning: Number of K-12 students learning Chinese on the rise. ESchool News. Retrieved from KEN=96746420
  10. Faulkner, L. (2003). Beyond the five-user assumption: Benefits of increased sample sizes in usability testing. Behavior Research Methods, Instruments, & Computers, 35(3), 379-383.
  11. Graham, L. (1998). The principles of interactive design. Albany, NY: Delmar Publishers.
  12. Hancock, R.D., & Algozzine, B. (2006). Doing case study research: A practical guide for beginning researchers. New York: Teachers College Press.
  13. Hornbæk, K. (2010). Dogmas in the assessment of usability evaluation methods. Behaviour& Information Technology, 29(1), 97-111.
  14. Horton, S. (2005). Access by design: A guide to universal usability for web designers. Berkeley, CA: New Riders.
  15. Huang, C.-K., Chao, Y.-C., & Lin, C.-Y. (2008). Web 2.0 in and out of the language classroom. Proceedings of the 2008 World CALL: Using Technologies for Language Learning. Foukoka, Japan, q-039.
  16. Huang, C.-K., Lin, C.-Y., & Chiang, Y.-H. (2010). Incorporating competency-based blended learning in a Chinese language classroom: A Web 2.0 Drupal module design. International Journal on E-Learning, 9(4). Retrieved March 10, 2010 from AACE publication database.
  17. Koohang, A., & Du Plessis, J. (2004). Architecting usability properties in the e-Learning instructional design process. International Journal on E-Learning, 3(3), 38-44.
  18. Krug, S. (2006). Don’t make me think: A commonsense approach to web usability (2nd ed.). Berkeley, CA: New Riders
  19. Ku, H.-Y., & Lohr, L.L. (2006). A case study of Chinese students’ attitudes toward their first online learning experience. Educational Technology Research and Development, 51(3), 95-102.
  20. Kukulska-Hulme, A. (1999). Language and communication: Essential concepts for user interface and documentation design. New York: Oxford University Press.
  21. Lan, Y.J. (2009, July). 資訊融入華語教學設計理念與實踐 [Technology integration in the philosophy and practice of Chinese language instructional design]. Paper presented at the International Conference on Internet Chinese Education (ICICE 2009), Taipei, Taiwan.
  22. Lanclos, P. (2008). Weaving Web 2.0 tools into the classroom. Eugene, OR: Visions Technology.
  23. Lim, C.J., & Lee, S. (2007). Pedagogical usability checklist for ESL/EFL e-learning web-Evaluating CSL/CFL Website Usability: A User-centered Design 207
  24. Lin, M.-C., & Wang, P.-Y. (2008). A knowledge management system for Chinese language arts teachers. British Journal of Educational Technology, 39(5), 935-943.
  25. Liu, M., Traphagan, T., Huh, J., Koh, Y.I., Choi, G., & McGregor, A. (2008). Designing Websites for ESL learners: A usability testing study. CALICO Journal, 25(2), 207240.
  26. Lund, M.A. (2006). Post-modern usability. Journal of Usability Studies, 2(1), 1-6.
  27. Lynch, J.P., & Horton, S. (2008). Web style guide: Basic design principles for creating websites (3rd ed.). New Haven, CT: Yale University Press.
  28. Mayer, E.R. (2009). Multimedia learning (2nd ed.). New York: Cambridge University Press.
  29. McLeod, J., & Vasinda, S. (2008). Critical literacy and Web 2.0: Exercising and negotiating power. Computers in the Schools, 25(3), 259-274. Doi:10.1080/07380560802394815
  30. Mehlenbacher, B. (2002). Assessing the usability of online instructional materials. In R.S. Anderson, J.F. Bauer& B.W. Speck (Eds.), Assessment strategies for the online class: From theory to practice (pp. 91-98). San Francisco: Jossey-Bass.
  31. Merriam, B.S. (1998). Qualitative research and case study applications in education: Revised and expanded from case study research in education. San Francisco: JosseyBass.
  32. Nielsen, J. (1993). Usability engineering. San Diego, CA: Academic Press.
  33. Nielsen, J., & Landauer, K.T. (1993). A mathematical model of the finding of usability problems. Proceedings of ACM INTERCHI’93 Conference, Amsterdam, Netherlands, 206-213.
  34. Nielsen, J., & Loranger, H. (2006). Prioritizing web usability. Berkeley, CA: New Riders.
  35. Nokelainen, P. (2006). An empirical assessment of pedagogical usability criteria for digital learning material with elementary school students. Educational Technology& Society, 9(2), 178-197.
  36. Norman, D.A. (2002). The design of everyday things. New York: Basic Books.
  37. Peterson, M. (1998). The virtual learning environment: The design of a website for language learning. Computer Assisted Language Learning 11(4), 349-361. Doi:10.1076/call.11.4.349.5669
  38. Phyo, A. (2003). Return on design: Smarter web design that works. Berkeley, CA: New Riders.
  39. Ronnie, L. (2007). The practical guide to information design. Hoboken, NJ: John Wiley& Sons Inc.
  40. Rubin, J. & Chisnell, D. (2008). Handbook of usability testing: How to plan, design, and conduct effective tests (2nd ed.). New York: Wiley.
  41. Sharp, H., Rogers, Y., & Preece, J. (2007). Interaction design: Beyond human-computer interaction. Chichester, UK: John Wiley& Sons.
  42. Shedroff, N. (1994). Information interaction design: A unified field theory of design. Retrieved May 22, 2010, from Shield, L., & Kukulska-Hulme, A. (2006). Are language learning websites special? Towards a research agenda for discipline-specific usability. Journal of Educational Multimedia and Hypermedia, 15(3), 349-369.
  43. Tidwell, J. (2006). Designing interfaces. Sebastopol, CA: O’Reilly Media.
  44. Tsou, W., Wang, W., & Tzeng, Y. (2006). Applying a multimedia storytelling website in foreign language learning. Computers& Education, 47(1), 17-28. Doi:10.1016/J.Compedu.2004.08.013
  45. Wu, S.-M. (2008). Robust learning for Chinese heritage learners: Motivation, linguistics and technology. In K. Kondo-Brown& D.D. James (Eds.), Teaching Chinese, Japanese, and Korean heritage language students: Curriculum needs, materials, and assessment. New York: Lawrence Erlbaum Associates.
  46. Yin, R.K. (2003). Case study research: Design and methods (3rd ed.). Thousand Oaks, CA: Sage.
  47. Zaphiris, P., & Kurniawan, S. (2007). Human computer interaction research in web design and evaluation. Hershey, PA: Idea Group
  48. Zhu, F. (2009). Chinese 101 & 102. CALICO Journal, 26(2), 457-467.

These references have been extracted automatically and may have some errors. If you see a mistake in the references above, please contact