In our team-based research at CDC, we've found it to be very important to
pay a lot of attention to inter-coder reliability issues. Having multiple
people code the same data requires that we develop & refine very clear
codebooks. It also helps us identify additional information that a single
coder working alone might miss.
Both AnSWR and CDC EZ-Text offer inter-coder reliability statistics and
report-generating capabilities. Additional information can be found in one
of my articles: Carey, J. W., Morgan, M., and Oxtoby, M. J. (1996)
Inter-coder agreement in analysis of responses to open-ended interview
questions: examples from tuberculosis research. Cultural Anthropology
Methods Journal 8(3): 1-5. Reprints are available from the two websites
provided by Stephen below.
Cheers,
Jim
> -----Original Message-----
> From: Stephen Furner [SMTP:[log in to unmask]]
> Sent: Friday, July 14, 2000 6:36 AM
> To: qual-software
> Subject: Re: 2 person coding on Nvivo
>
> The tools avilble as a free download from CDC at Atlanter have facilties
> in
> them to support team working. These can be found at:
>
>
> CDC EZ-text
>
> "Project managers can merge data files generated by different interviewers
> for combined cross-site analyses. The ability to export and import the
> codebook helps to coordinate the efforts of multiple coders . . ."
>
> http://www.cdc.gov/hiv/software/ez-text.htm
>
>
>
> CDC AnSWER
>
> "AnSWR is a software system for coordinating and conducting large-scale,
> team-based analysis projects that integrate qualitative and quantitative
> techniques."
>
> http://www.cdc.gov/hiv/software/answr.htm
>
>
> Stephen Furner
>
>
>
>
>
>
> ----- Original Message -----
> From: Susanne Friese <[log in to unmask]>
> To: qual-software <[log in to unmask]>
> Sent: Friday, July 14, 2000 11:13 AM
> Subject: Re: 2 person coding on Nvivo
>
>
> >
> >
> >
> > ----- Original Message -----
> > From: <[log in to unmask]>
> > To: <[log in to unmask]>
> > Sent: Friday, July 14, 2000 11:36 AM
> > Subject: Re: 2 person coding on Nvivo
> >
> >
> > >
> > > >Can anyone offer some words of wisdom on how 2 people can share
> > > >the coding of a project in Nvivo...?
> > >
> > > This should be put on top of the to do list for all QDA software
> > > developers. The lack of support for effective teamwork in current
> software
> > > is a major obstacle to use QDA packages effectively.
> >
> > You are not completely correct here - some packages offer team support,
> even
> > though it may not be perfect yet. Both Atlas.ti and Nud*ist offer merge
> > functions. This way you can merge documents that have been coded by two
> or
> > more researchers. Atlas.ti also has a coding analyser where you can
> clean
> up
> > the codes. (Nud'ist may or may not have a smiliar function). The
> programme
> > will find all those places where coding is doubled up, e.g. if one coder
> has
> > coded 3 lines and the oder 5 lines with the same code. You can also (if
> you
> > wanted) use the SPSS export function to export the coding scheme in
> order
> to
> > calculate interrater reliablity. You have to do some cleaning up of the
> > data, but it can be done.
> >
> > There are also a number of other tools that can be exploited for team
> work,
> > like filters and certain outputs.
> >
> >
> > regards, Susanne
> >
> >
>
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
|