All,
Thanks for the advice. We thought that self-assessment was the answer
but only if students E and F give each other and themselves a score of
1, rounding the WebPA adjustment factor to 1 and giving everyone in the
group 70%. However, if students E and F give themselves 5 in the
self-peer assessment, their total awarded marks change to 10
respectively. Students A-D, get fractional scores of 0.1 from E and F (a
total of 0.2), whereas E and F get 0.1 and 0.5 (0.6 in total). Therefore
the adjusted marks would be 64.4% for students A-D and 81.2% for
students E-F. They get a massive bump up in marks because they think
they did great, despite the other disagreeing.
*head scratch :/
Jeff
On 25/06/2014 21:02, Paul A Chin wrote:
> Hi Jeff,
>
> Unfortunately I'm a harsher penaliser than Keith, partly because I explain to the students they have a responsibility to their fellow group members to submit their marks and don't want them to let each other down. But like Keith, I put the caveat in that I may have to arbitrate and override the marks. I tell them that I have the final say in cases of dispute - though fortunately I've never had to step in and disregard the WebPA marks, so far...
>
> Regards
>
> Paul
>
>
> -----Original Message-----
> From: WebPA [mailto:[log in to unmask]] On Behalf Of Keith Pond
> Sent: 25 June 2014 2:55 PM
> To: [log in to unmask]
> Subject: Re: Sceptical Results from worst case scenarios
>
> I've always used a small penalty - 5% for non-participation (that's 5 percentage points deducted from an individual mark, it seems to be enough. The opportunity to add text comments to scores in later versions also helps to engage.
>
> Over many years, however, I have found that those not participating are also those not participating in the group work.
> Also - the system does not always deal well with extremes and tutors may need to intervene to discount the Web_PA score and bang student heads together. After a while tutors can build up a sense of whether the scores given and received make sense. I always reserve the right to NOT use WebPA for particular groups where there is evidence of group disputes etc.
>
> Keith
>
> Keith Pond
> Associate Dean (Teaching)
> School of Business and Economics, Loughborough University, LOUGHBOROUGH, LE11 3TU, United Kingdom.
> +44(0)1509 223290
> P Please consider the environment - do you really need to print this e-mail?
>
> This e-mail is intended only for the above addressee. It may contain privileged information. All statements and opinions in this e-mail are made without liability and without prejudice. If you are not the addressee you must not copy, distribute, disclose or use any of the information in it. If you have received it in error please delete it and notify the sender immediately.
>
> -----Original Message-----
> From: WebPA [mailto:[log in to unmask]] On Behalf Of SEIFERHELD Inger
> Sent: 25 June 2014 14:19
> To: [log in to unmask]
> Subject: Re: Sceptical Results from worst case scenarios
>
> We see the peer assessment as part of the assessment so we will apply the same kind of penalty for not returning peer marking as if it was the work itself.
> ~Inger
>
>
>
> --
> The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.
>
>
> -----Original Message-----
> From: WebPA [mailto:[log in to unmask]] On Behalf Of Jeffrey Barrie
> Sent: 25 June 2014 13:27
> To: [log in to unmask]
> Subject: Sceptical Results from worst case scenarios
>
> All,
>
> I would appreciate your advice on this issue.
>
> At the University Of Bath, we have been running trials in replacing our paper-based peer-assessment procedures with WebPA. Initial results are promising however we find that in some groups, not all students participate (some are forgetful, or just can't be bothered).
>
> The peer assessment is conducted in groups of 6, they are peer-assessed only (i.e. no self-assessment) and there is no penalty for not taking part. Their contribution is assessed using Likert scale 1-5 and 20% of their marks are peer-moderated
>
> So, lets take a look at a group of 6 students, students A,B,C,D,E,F.
> Students E and F take part in WebPA but A-D do not. Students E and F give everyone a score of 1 (excluding themselves). The group mark is 70%-so (0.2 x 70)=14 marks are peer moderated
>
> The total received score is 2 for students A-D and 1 for students E-F.
> The total awarded score is 0 for students A-D and 5 for students E-F (according to the WebPA).
>
> As Students E and F participated (and the others did not), their cake is split into 5 slices, with scores of 1, each member of the team (excluding themselves) gets a fractional score of 0.2.
>
> This is where it gets interesting, as now a fudge factor is applied, in this case 6 students/2 students = 3.
>
> Because Students A-D get two scores of 1, their WebPA scores are
> (0.2+0.2)x3=1.2 each, so the final marks are 56%+(1.2 x 14)=72.8%
>
> Students E-F only get one score of 1 (from each other) so their WebPA scores are 0.2 x 3=0.6 each. The final marks are 56%+(0.6x14)=64.4%
>
> So, in summary students E-F are hard done by, getting lower marks despite thinking that everyone was rubbish and participating in the WebPA process. Students A-D are laughing as they have had their marks increased by doing nothing.
>
> If students E-F, give all scores of 5. The marks come out the same!
>
> Is this right or have I made a miscalculation? We are considering:
>
> 1. Adding a penalty to non-participation 2. Adding self-peer assessment (so students E-F have a say in their own
> performance)
> 3. Discounting peer-moderated marks of groups with less than 50% participation.
>
> Any thoughts?
>
> Best Regards,
>
> Jeff Barrie
>
> Dept of Mechanical Engineering
> University of Bath
>
>
>
> **************************************************
> To view the terms under which this email is
> distributed, please go to
> http://www2.hull.ac.uk/legal/disclaimer.aspx
> **************************************************
|