Dear Margaret,
In the last summer I have had the same problem.
I suggest you to read the following paper.
J Clin Epidemiol. 1990;43(6):543-9. High agreement but low kappa: I. The
problems of two paradoxes.
Feinstein AR, Cicchetti DV. Yale University School of Medicine, New Haven,
CT 06510.
For me the paper of Drake is been important: Sensitivity, specificity and
other diagnostic measures with multiple site per unit.
I suggest you to calculate the Confidence Interval with the archsen formula.
I hope I have been helpful.
rosalba
-----Messaggio originale-----
Da: A UK-based worldwide e-mail broadcast system mailing list
[mailto:[log in to unmask]] Per conto di Margaret MacDougall
Inviato: martedì 11 gennaio 2011 13:49
A: [log in to unmask]
Oggetto: Confidence interval for average Kappa
Hello
I would be grateful to receive some relevant advice on calculating a
confidence
interval for an average Kappa statistic, where this average has been
obtained
over multiple simple Cohen Kappa statistic each of which are related. (The
relatedness arises from the fact that the individual Kappas are evaluated
for
specific categories of segments of a human blood vessel. Each individual
Kappa
has therefore been obtained for a specific category of segment but the
patient
sample is the same in each case.) The intention is to obtain an agreement
statistic over the patient sample for the whole vessel and therefore I am
attempting to find an appropriate way to pool the Kappa values rather than
treat
the data as one grand sample from the outset and ignore the relatedness. I
am
not convinced that a simple average is best here either but I was unable to
find
a suitable alternative in the literature. Help in this area would also be
valued.
Many thanks
Best wishes
Margaret
You may leave the list at any time by sending the command
SIGNOFF allstat
to [log in to unmask], leaving the subject line blank.
-----------------------------------------------------------------------------------
SOSTIENI ANCHE TU LA RICERCA DEL SAN RAFFAELE.
NON C'E' CURA SENZA RICERCA.
Per donazioni: ccp 42437681 intestato a Fondazione Arete' Onlus del San Raffaele.
Per informazioni: tel. 02.2643.4461 - www.sanraffaele.org
You may leave the list at any time by sending the command
SIGNOFF allstat
to [log in to unmask], leaving the subject line blank.
|