I'm not 100% clear on the nature of the task but it strikes me that Google Forms
could be the answer. It operates inside Google Drive and spits out a spreadsheet with
all the responses (much more useable than the ouput of Survey Monkey, and easily
copied into Excel for more advanced statistical fun), so you could potentially do the
kinds of discrepancy analysis you're talking about.
There are stacks of online tutorials for Google Forms. Give it a look.
In any event, it's great you're thinking of ways to lessen the physical burden!
Dave
--
Dr. Dave Sayers, ORCID no. 0000-0003-1124-7132
Senior Lecturer, Dept Humanities, Sheffield Hallam University | www.shu.ac.uk
Honorary Research Fellow, Cardiff University & WISERD | www.wiserd.ac.uk
Communications Secretary, BAAL Language Policy group | www.langpol.ac.uk
[log in to unmask] | http://shu.academia.edu/DaveSayers
On 03/04/2018 13:46, McGarry, Theresa Marie wrote:
> This question isn’t specific to linguistics, but some of the people on this group
> appear to exactly the kind of people who’d know, so I hope it’s okay to ask. I’m the
> new director of writing proficiency, across the curriculum, at my university. Every
> three years we assess the writing skills of seniors by gathering their submissions
> for writing assignments in senior-level courses, anonymizing them, and evaluating
> them. This is the year, and it’s my first time doing it.
>
> Until now, the assessment has been done by a bunch of raters gathered together for
> two days. I’m planning instead to do it more or less the way most conferences, I
> think, now carry out abstract review: the raters are assigned a certain number of
> papers to evaluate, and they access them and fill out the evaluation rubric online.
> Ideally, the software would then identify threshold discrepancies in the two ratings
> given each paper, so that particular papers could be assigned a third review, but if
> necessary that could be done by hand.
>
> My question is what software to use for this. The vice provost knows how to use
> Survey Monkey and says doing that will be possible but problematic. We have D2L at
> the university, and of course the process could be constructed as a series of
> quizzes, but only with a lot of manual labor assigning the papers and compiling the
> results. Does anybody have a better suggestion?
>
> Theresa McGarry
>
|