Hi Paul,
The only example of how the feedback works is a brief overview that I
created for reference, which is available at
http://webpa.wiki.sourceforge.net/How+the+feedback+is+calculated
I think that we will, as a project, need to evaluate the current methods
that people use to provide feedback on the peer assessment, before we look
at extending any functionality. My first concerns are that we should ensure
the methods that the system currently provides work for as many users as
possible and are not going to cause any problems when students see the
feedback.
I am glad that you can see ways in which WebPA can be expanded and I would
like to capture this information, so I have added the information to the
source forge area for the project. By doing this I am trying to ensure your
valid points are not overlooked, but can be revisited when the project feels
that they are better equipped to address the points. You can view and follow
the 'feature request' at
http://sourceforge.net/tracker/index.php?func=detail&aid=1799539&group_id=19
4016&atid=947740
Thanks
Nic
---------------------------------------------------------------------------
Nicola Wilkinson
eLearning Systems Developer
WebPA Project, engCETL
Tel: 01509 22 7186
email: [log in to unmask]
Web: http://webpaproject.lboro.ac.uk/
JISCmail: http://www.jiscmail.ac.uk/lists/webpa.html
Project Blog: http://webpa-tec.blogspot.com/
----------------------------------------------------------------------------
-----Original Message-----
From: WebPA Project [mailto:[log in to unmask]] On Behalf Of Paul A Chin
Sent: 21 September 2007 09:44
To: [log in to unmask]
Subject: Re: Feedback Calculation
Hi Nicola,
I've not used the feedback option yet so don't know what format it comes
as. Could you provide an example please? Given this, at the risk of
saying irrelevant points if not valid, I think the feedback option
(which I presume is simply based on the scores) does need more work.
First of all, I agree with Adam on the wording. The risk of scoring
students for each critierion however, is that it can be too
prescriptive.
For example, a group collaborate to produce a piece of work. They each
have their strengths so will probably contribute more on different
tasks. Assuming an 'equal' team they will grade each other equally well
overall so to try to offer over prescriptive score feedback for each
criterion might not be the best form of feedback.
Not having used the feedback option yet I don't know if you can or not,
but to me, written feedback is probably more important to explain things
- though this is not an autogenerated thing like the current feedback.
Importantly for the development of WebPA, I would like to see the
feedback and review aspect extended. It would be good to allow students
to offer textual feedback which could be collated and viewed by each
member. i.e. each student would receive all the written comments from
their fellow members. In addition to this, WebPA has the potential to
become a true collaboration tool if this could be extended to allow
online reviews. E.g. students could share their work online and get
feedback to help inform its development before submission of the work.
Research backs up the logic that this will improve learning and some
tools have already been developed to try to do this.
Regards
Paul
-----Original Message-----
From: WebPA Project [mailto:[log in to unmask]] On Behalf Of
A.R.Crawford
Sent: 17 September 2007 10:26
To: [log in to unmask]
Subject: Feedback Calculation
Please can we have 'You where rated", changed to "You were rated"
The problem currently is that the weighting gives your relative mark
within
the group rather than their overall mark, so a weaker member in a really
good group (getting 80%) could still be heading for a 70% mark and could
take offence at being rated as below average as their overall mark is
still
above average. I think we need to look at the wording.
An alternative based on good feedback practice would be to say:
The area that you scored most highly on was...
The area that you most need to work on is ...
Adam
|