Dear Teresa and colleagues Royce Sadler's ideas on this subject are worth discussing. Royce has visited leeds met for the last tow years and we hope to host him again in May when we anticipate he will visit us again. If colleagues are interested in meeting him at Leeds Met to discuss this idea (and others) or inviting him to visit you at your institution, please contact me Best wishes Sally ------------------------------------------------------------------- Professor Sally Brown Pro-Vice-Chancellor (Academic) Leeds Metropolitan University Room G03, Old School Board Calverley St, Leeds LS1 3ED Phone: 0113 812 6765 ------------------------------------------------------------------ -----Original Message----- From: Online forum for SEDA, the Staff & Educational Development Association [mailto:[log in to unmask]] On Behalf Of Teresa McConlogue Sent: 14 August 2009 16:17 To: [log in to unmask] Subject: guild of markers Dear All I am currently writing a paper on peer assessment. One of the issues that has emerged is subjectivity in marking. I've been reading studies about explicit marking criteria and tacit knowledge and I've come across the idea of a 'guild of markers' (Sadler) and also 'community of assessors'. However, I can find no research studies into the reliability of marking of a 'guild' or 'community'. I know tutors claim that working together in a small team, they often assign very similar grades to work, hence the assumption is that they have managed through discussion to exchange tacit knowledge about standards. However, I would like to see some research evidence. It may be that tutors use safe marking practices and a small range of marks, so it's not surprising that their marks are similar. Is anyone aware of any studies that either dispute or support the idea of a guild of markers? I would be very grateful if you could send me some references. Many thanks Teresa McConlogue -- Dr. Teresa McConlogue Thinking Writing Advisor Queen Mary, University of London Mile End Road London E1 4NS Direct Telephone: 020 7882 2834 To view the terms under which this email is distributed, please go to http://disclaimer.leedsmet.ac.uk/email.htm