Hi
We use QMP in our IT suite with up to 150 or so students at a time. We
also use it through Blackboard to deliver our annual student
satisfaction survey. We use a clever technical solution to deliver the
test on the PCs in the IT Suite using QuestionMark To Go. The main
issue, of course, with high stakes testing, is authentication and
invigilation - no problem if you only do it in a controlled environment.
We're currently working on a solution for tying together student and PC
by barcode to cope with those little unexpected problems where results
aren't captured. Not sure you'd call this "online" exactly - how would
you verify examinee's identity in a totally open online high stakes
CBE?
--
Regards
Mark
Mark Gamble
Head of e-Learning
Learning Technology
University of Bedfordshire, Park Square, Luton, Beds, LU1 3JU
Tel (+44)1582 489260 Mob 07720 068605
Int ext 2260 / 6360 (mobex)
>>>
From: Fiona <[log in to unmask]>
To: <[log in to unmask]>
Date: 2/17/2010 5:11 PM
Subject: Re: Online High Stake Multiple Choice Quizzes
Many thanks,
Just to pick up and recap on the points raised by Jim and Jen on using
Blackboard for high stakes assessment:
1. Several people seem to be using a dual paper/online version.
2. Blackboard is not a reliable solution for large cohorts
3. Training of faculty in using the right settings/knowing how to clear
the
exam/turn to a paper protocol/save data is important.
Thanks very much for your feedback and comments. I would still be keen
to
share some more mundane details off list with anyone willing on how
they
deal with ³hiccups² in a live exam. Please feel free to get in touch
with me
directly if you have any experience in dealing with these.
Finally, are any subscribers to the list using Questionmark Perception
integrated within their Blackboard environment? If so, we would also
really
like to hear about your deployment. In particular, can it address the
reliability issue (ref. 2 above) or will network glitches/end users
hardware/software environments always be a problem?
Kind Regards
Fiona
--
Fiona Concannon
Centre for Excellence in Learning & Teaching (CELT)
National University of Ireland Galway
Galway
Ireland
W: www.nuigalway.ie/celt
T: +353 (0)91 495630
On 17/02/2010 14:45, "Jennifer Tierney"
<[log in to unmask]>
wrote:
> Hi Fiona. We use only Blackboard for all exams with a paper backup (I
generate
> those with Respondus as needed). Since our student/customers are
scattered
> across our state, we've often been faced with computers that are
missing
> plugins, current Java versions, etc., and have virtually no control
over the
> proctored lab. Still, even with the obstacles tech-wise, we rarely
resort to
> paper. When we do use paper finals, it is often for issues such as
internet
> access outages, etc.
>
> I would also note that Blackboard has a lot of room to grow a more
robust
> testing environment that allowed for 'fixing' individual testing
hiccoughs
> besides just clearing an exam.
>
> Regards,
>
> Jenn
> ~==========~
> * Jennifer Tierney-Sveigdalen * Idaho Digital Learning Academy
Information
> Technology * 208/342-0207 * 1-800-927-8158 *
>
> On 17/02/2010 07:53, "Turner, James" <[log in to unmask]> wrote:
> Hi Fiona
> At JMU we have blackboard 8. We do run some high stakes exams, with
all the
> appropriate student and systems support. These are run under exam
conditions.
> We advise staff to use large pools of questions and randomise order
and
> randomise the questions used. However they tend to be for small
cohorts. We
> have an issue over IT lab sizes for running large cohorts. We have
had issues
> in the past with lost data due to human error, but everything is
running find
> at the moment.
> Jim
>
>
>
> On Tue, Feb 16, 2010 at 8:49 AM, Fiona <[log in to unmask]>
wrote:
>> Hello all,
>>
>> We are exploring options to enable faculty to electronically
conduct
>> high-stakes multiple-choice quizzes with their students. Previously,
some
>> members of staff have been using Blackboard in tandem with a
paper-back up.
>> However, judging from our experience and from other institutions
websites -
>> Blackboard is a far from ideal solution for carrying out anything
other than
>> low-stake practice tests. Is this the consensus of members on this
list?
>>
>> Has anyone else been using any other assessment software (either
from within
>> Blackboard as a Building Block or as a stand alone solution) which
they might
>> recommend? If you are using (or know of) any, we would be really
interested
>> to hear from you.
>>
>> Kind Regards
>>
>> Fiona
>>
|