hi-
i have two coders coding messages for me from internet newsgroups and need to check
their inter-coder reliability. i believe i want to use cohen's kappa, but i'm not
sure a) how to set this up in SPSS and b) if it can handle instances where one coder
assigns 3 sets of codes to one message and the second coder assigns 4 sets of codes
to the same message.
i have five categories with specific codes that are applied to each text segment any
time a segment is identified as needing to be coded.
If I can't use Cohen's Kappa, would Scott's pi work?
I have Krippendorff's book, but I was hoping for something more user friendly.
Any help would be greatly appreciated.
Thanks in advance,
Peter Newman
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
|