Both of these are covered in Johnstone AH, Abdullah A, "Fixed response:
What are we testing?" Chem. Educ. Res. Pract. Eur. 2000; 1: 323-328 - on
the web as a pdf:
http://www.uoi.gr/conf_sem/cerapie/2000_October/pdf/04Johnst.pdf
Kim
At 10:47 22/03/2001 +0000, you wrote:
>Hi Everyone,
>
>There is some evidence (Alex Johnstone, Glasgow Centre for Science
>Education) that even changing the order of the distractors in a
>multiple choice question can change the facility value - and there is
>also evidence for timed exams that it matters whether students are
>given easy or difficult questions at the start of the exam. That is,
>randomizing exams by shuffling the order of questions is also
>suspect. (Can't remember offhand where that comes from.)
>
>Mary Masson
Mr Kim Whittlestone, BVetMed
Educational Resource Manager
Clinical & Biomedical Computing Unit
University of Cambridge Clinical School
Box 111, Addenbrooke's Hospital
Hills Road, Cambridge CB2 2SP, UK
CBCU: http://www.cbcu.cam.ac.uk/
ERWeb: http://axis.cbcu.cam.ac.uk/ERWeb/
CALReviews: http://axis.cbcu.cam.ac.uk/CALReviews/
--
|