Introducing Computer Adaptive Testing to a Cohort of Mathematics Teachers: The Case of Concerto

S. Kanageswari Suppiah Shanmugam, Leong Chee Kin


This article describes a study that explores on-line assessment, with the objectives to identify features that support or impede the usability of Concerto, an on-line adaptive testing software that was developed by the Psychometrics Centre of the University of Cambridge. We report on the analysis of data collected during a one-month in-service programme organised for secondary teachers and teacher educators from the Southeast Asian Minister of Education Organisation (SEAMEO) region. The study identifies the challenges the participants encountered during a one-day workshop and evaluates the
difficulties of adopting Concerto to create a simple and an adaptive on-line mathematics test. While the small study limits the possibility of applicability for other samples, yet the findings of the study illustrate the complexity of using the Concerto’s features and the commonly occurring difficulties, providing the basis for the development of some new workshop materials that will contribute to the improvement of introductory Concerto workshops that will be conducted in the future.


Concerto; computer adaptive testing (CAT); on-line adaptive testing; assessment; testing

Full Text:



Barker, P. (Ed.).(1974). Designing multi-media workstations. In P. Barker (Ed.), Multi-media Computer Assisted Learning (pp.53-77). New York, NY: Nicholas Publisher.

Erstad, O. (2008). Changing Assessment Practices and the Role of IT. International Handbook of Information Technology in Primary and Secondary Education , 20( 2),181-194.

Georgiadou, E., Triantafillou, E.,& Economides, A. (2006). Evaluation parameters for computer adaptive. British Journal of Educational Technology , 37(2), 261-278.

Hambleton, R. K., Swamination, H., & Rogers, H. J. (1991). Fundamentals of item response theory. California: Sage Publications Inc.

Laborde, C. (2001). Integration of technology in the design of geometry tasks with Cabri-Geometry. International Journal of Computers for Mathematical Learning, 6, 283-317.

Lagrange, J. B., Artigue, M., Laborde, C., & Trouche, L. (2003). Technology and mathematics education: a multidimensional study of the evolution of research and innovation. In A. J. Bishop, M. A. Clements, C. Keitel, J. Kilpatrick, & F. K. S. Leung (Eds), Second International Handbook of Mathematics Education, (pp. 237-269). Dordrecht: Kluwer Academic Publishers

Lilley, M. & Barker, T. (2002). The development and evaluation of a computer-adaptive testing application for English language. In Proceedings of the 6th Computer-assisted Assessment Conference (pp. ). Loughborough University, UK.

Linacre, J.M. (2000). Computer-Adaptive Testing: A Methodology Whose Time Has Come. Retrieved from

Lord, F. M. (1980). Applications of item response theory to practical testing problems. NJ:Lawrence Erlbaum Associates, Publishers.

Lund A. M. (2001). Measuring Usability with the USE Questionaire. Society for Technical Communication Newsletter, 8(2).

Partners in Learning (2012).History of CAT. Retrieved from


Root, R. W., & Draper, S. (1983). Questionnaires as a Software Evaluation Tool Interface Design 4 Analyses of User Inputs Proceedings of ACM CHI'83 Conference on Human Factors in Computing Systems . New York:ACM.

Rudner, L. (1998). An on-line, interactive, computer adaptive testing mini tutorial. ERIC Clearinghouse on Assessment and evaluation.

Russell, M. (2006). Technology and assessment: the tale of two interpretations. United Sates of America: Information Age Publishing Inc.

Wainer, H. (1990). Computerized adaptive testing. NJ: Lawrence Erlbaum Associates.



  • There are currently no refbacks.

Indexed by:


Southeast Asian Mathematics Education Journal
SEAMEO Regional Centre for QITEP in Mathematics
Jl. Kaliurang Km 6, Sambisari, Condongcatur, Depok, Sleman
Yogyakarta, Indonesia
Telp. +62 274 889955

p-ISSN: 2089-4716 | e-ISSN: 2721-8546

Southeast Asian Mathematics Education Journal is licensed under a Creative Commons Attribution 4.0 International License

View My Stats

 Supported by: