Hi Fiona

Just wanted to clear up any mis-understanding, we aren’t using BB for large cohort exams because we don’t have a way of block booking IT labs for large cohorts. It’s nothing to do with any issues with BB technology.

 

We have run large cohorts through one large IT lab in groups of 40, but the organisation is quite tricky

 

I’m not sure you have come across this book, but it covers all the issues involved in this process

Blueprint for computer-assisted assessment

 By Joanna Bull, Colleen McKenna

 

http://books.google.co.uk/books?id=1bCpLR0xjLIC&pg=PA1&lpg=PA1&dq=Blueprint+for+Computer-Assisted+Assessment+By+Joanna+Bull+%26+Colleen+McKenna&source=bl&ots=2ZzaOVoIxS&sig=kAoXpJ8gI4cDa5o_aMFJ6Ob3CMo&hl=en&ei=Bwl9S7m_MoqQjAfPjO2KDA&sa=X&oi=book_result&ct=result&resnum=1&ved=0CAcQ6AEwAA#v=onepage&q=&f=false

jim

 

 

 

Many thanks,

Just to pick up and recap on the points raised by Jim and Jen on using Blackboard for high stakes assessment:

1. Several people seem to be using a dual paper/online version.
2. Blackboard is not a reliable solution for large cohorts
3. Training of faculty in using the right settings/knowing how to clear the exam/turn to a paper protocol/save data is important.

Thanks very much for your feedback and comments. I would still be keen to share some more mundane details off list with anyone willing on how they deal with “hiccups” in a live exam. Please feel free to get in touch with me directly if you have any experience in dealing with these.  

Finally, are any subscribers to the list using Questionmark Perception integrated within their Blackboard environment? If so, we would also really like to hear about your deployment. In particular, can it address the reliability issue (ref. 2 above) or will network glitches/end users hardware/software environments always be a problem?

Kind Regards

Fiona


--
Fiona Concannon
Centre for Excellence in Learning & Teaching (CELT)
National University of Ireland Galway
Galway
Ireland

W: www.nuigalway.ie/celt
T:  +353 (0)91 495630
 


On 17/02/2010 14:45, "Jennifer Tierney" <[log in to unmask]">[log in to unmask]> wrote:

Hi Fiona. We use only Blackboard for all exams with a paper backup (I generate those with Respondus as needed). Since our student/customers are scattered across our state, we've often been faced with computers that are missing plugins, current Java versions, etc., and have virtually no control over the proctored lab. Still, even with the obstacles tech-wise, we rarely resort to paper.  When we do use paper finals, it is often for issues such as internet access outages, etc.

I would also note that Blackboard has a lot of room to grow a more robust testing environment that allowed for 'fixing' individual testing hiccoughs besides just clearing an exam.

Regards,

Jenn
~==========~
* Jennifer Tierney-Sveigdalen * Idaho Digital Learning Academy Information Technology * 208/342-0207 * 1-800-927-8158 *

On 17/02/2010 07:53, "Turner, James" <[log in to unmask]">[log in to unmask]> wrote:

 

Hi Fiona
At JMU we have blackboard 8. We do run some high stakes exams, with all the appropriate student and systems support. These are run under exam conditions. We advise staff to use large pools of questions and randomise order and randomise the questions used. However they tend to be for small cohorts. We have an issue over IT lab sizes for running large cohorts. We have had issues in the past with lost data due to human error, but everything is running find at the moment.
Jim
 
 

On Tue, Feb 16, 2010 at 8:49 AM, Fiona <[log in to unmask]">[log in to unmask]> wrote:

Hello all,

We are exploring options to enable faculty to electronically conduct high-stakes multiple-choice quizzes with their students. Previously, some members of staff have been using Blackboard in tandem with a paper-back up. However, judging from our experience and from other institutions websites – Blackboard is a far from ideal solution for carrying out anything other than low-stake practice tests. Is this the consensus of members on this list?

Has anyone else been using any other assessment software (either from within Blackboard as a Building Block or as a stand alone solution) which they might recommend? If you are using (or know of) any, we would be really interested to hear from you.

Kind Regards

Fiona