Dear all,
Can anyone help me in identifying research which has used inter-rater
reliability. More specifically I have interview data items (first order
constructs) which I have developed into propositions (second order
constructs). To check the reliability between the two I gave another rater
(someone who has no knowledge of the research) the propositions and the
individual data items (shuffled) and asked that the data items be placed
alongside the proposition the inter-rater thought most appropriate. The
first time match differed from proposition to proposition (65% was the
lowest and 92% the highest). What I would like to do now is to relate
these percentages to either another piece of primary research or, better
still, a secondary source (either of which would need to be readily
accesible). What complicate matters is that all of the sources I have
consulted have used inter-rater relaibility in different way (eg
observations). My research is essentially qualitative and so the sort of
sources I would be looking for would talk about 'trustworthiness' and
'credibility'. However, if anyone has information on inter-rater used in
statistical analysis that would be welcome too.
Thanks, Robbie Nicol
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
|