Hi again Patrick,
Just wanted to respond to your question at the end of your message. In terms of impacts, I think it is important to collect both pre- and post-Public engagement data that directly measures researchers' thinking in order to assess this. There are a number of specific questionnaire items I have used to this end in the past such as the 'thought-listing' items in the Science in Norwich Day evaluation ('please list the first five things that come to mind when you think of 'the public'', repeated pre- and post-engagement. In terms of post-engagement self-report focusing on positives, I suggest the question 'what, if anything, do you feel you have gained from this experience?'. These are some suggestions for questionnaires: of course there are a range of other methods that can be used such as focus groups and interviews.
I have argued in a couple of published commentaries against focusing ONLY on collecting positive anecdotes and relying only on post-engagement self-reports as these tend to exclude the possibility of negative impacts. Negative impacts from public engagement do happen and it is important to learn from these cases as well in order to increasingly limit their prevalence.
Best,
Eric
---------------
Dr Eric Jensen, Fellow Higher Education Academy
Assistant Professor of Sociology, University of Warwick
http://warwick.academia.edu/EricJensen
Office: Ramphal Building (2.17)
‘Evaluating Impacts of Public Engagement and Non-Formal Learning’ Seminar Series: http://www2.warwick.ac.uk/fac/soc/sociology/news/scd/publicengagement
Impact Project Manager, ESRC Centre for Competitive Advantage in the Global Economy, Department of Economics, University of Warwick
Master of Science in Science, Media and Public Policy at Warwick: http://www2.warwick.ac.uk/fac/soc/sociology/pg/prospect/programmes/smpp/
Sent from my iPad
On 24 Aug 2012, at 12:14, "Patrick Middleton (BBSRC, SO)" <[log in to unmask]<mailto:[log in to unmask]>> wrote:
Hi Helen and all,
I’m looking for any sort of evidence really. All I’m doing is collating bits and pieces from around the web. It’s good to know that you have some anecdotes. A few people have come back saying the same. Perhaps the best way to gather these might be in some form of very short questionnaire – the responses to which could then get published on the site.
Perhaps something like:
(1) What did you do?,
(2) Did you learn anything new?
(3) How has it affected what you think about your research?
(4) How has it affected what you do?
Do you (and other Psicommers) think this would be useful?
Capturing the less direct impacts/benefits is a real challenge – any idea how to measure and record these?
Thanks,
Patrick
Dr Patrick Middleton
BBSRC Head of Engagement
01793 413 368 | 07771 945 529
www.bbsrc.ac.uk<http://www.bbsrc.ac.uk/> | [log in to unmask]<mailto:[log in to unmask]> | @Patrick_Midd<http://www.twitter.com/Patrick_Midd>
From: psci-com: on public engagement with science [mailto:[log in to unmask]] On Behalf Of Featherstone, Helen
Sent: 24 August 2012 10:32
To: [log in to unmask]<mailto:[log in to unmask]>
Subject: Re: [PSCI-COM] Public engagement - why bother?
Hello Patrick
we have examples of researchers based at University of Exeter who have involved publics when undertaking research prioritisation exercises, during the research process and other researchers who make similar statements to the one offered by Eric following PE activities that invite discussion. Unfortunately, this is anecdotal, but I could put you in touch with these researchers if you wanted to speak with them.
Capturing this sort of evidence will be something we do here at Exeter – give me a bit of time and I’ll come back to you with some more concrete evidence!
There are some other aspects of the research process where PE can have an effect: impact/REF and the resultant QR income, securing funding by including high quality PE activity in grant proposals, ability to work in interdisciplinary teams... These all contribute to guiding the direction of research but the links are perhaps a little less direct?
Do keep us up to date as your project progresses, Patrick. Happy to discuss how we can contribute further.
Best wishes
Helen
From: psci-com: on public engagement with science [mailto:[log in to unmask]] On Behalf Of Jensen, Eric
Sent: 23 August 2012 18:10
To: [log in to unmask]<mailto:[log in to unmask]>
Subject: Re: [PSCI-COM] Public engagement - why bother?
Hi Patrick,
I wanted to highlight some relevant empirical research on this topic with which I have been involved.
The first is published research conducted for the ISOTOPE (Informing Science Outreach and Public Engagement) action research project (funded by NESTA). The first phase of this project involved research with scientists at various stages in their careers (and other science communicators) and identified the patterns of motivation and perceived benefits of involvement in public engagement activities. The results of this research are published in an Oxford University Press book:
Holliman, R. and Jensen, E. (2009). (In)authentic science and (im)partial publics: (re)constructing the science outreach and public engagement agenda, in Holliman, R., Whitelegg, E., Scanlon, E., Smidt, S. and Thomas, J. (eds.) Investigating science communication in the information age: Implications for public engagement and popular media. Oxford University Press, Oxford.
The results are also summarised in the freely available published final report on the project: http://isotope.open.ac.uk/?q=node/565
I would also point to an impact evaluation I conducted for a one-day science festival called ‘Science in Norwich Day’ earlier this year, which evaluated impacts on participating scientists (and other science communicators) along with visiting publics. While the aggregate picture in terms of impact on participating scientists’ thinking showed limited change, there were some individual cases that align with the kind of researcher outcomes you are interested in. For example, one early career scientist said the engagement event was defined by, “[Public] questions about science that you don't usually think of!’”.
This external evaluation report is freely available online here: http://soin.org.uk/wp-content/uploads/2012/01/Science-in-Norwich-Day-External-Evaluation-Report-Final.pdf
Best wishes,
Eric
---------------
Dr Eric Jensen, Fellow Higher Education Academy
Assistant Professor of Sociology, University of Warwick
http://warwick.academia.edu/EricJensen
Office: Ramphal Building (2.17)
‘Evaluating Impacts of Public Engagement and Non-Formal Learning’ Seminar Series: http://www2.warwick.ac.uk/fac/soc/sociology/news/scd/publicengagement
Impact Project Manager, ESRC Centre for Competitive Advantage in the Global Economy, Department of Economics, University of Warwick
Master of Science in Science, Media and Public Policy at Warwick: http://www2.warwick.ac.uk/fac/soc/sociology/pg/prospect/programmes/smpp/
From: "SO)" <[log in to unmask]<mailto:[log in to unmask]>>
Reply-To: "psci-com: on public engagement with science" <[log in to unmask]<mailto:[log in to unmask]>>
Date: Thursday, 23 August 2012 17:09
To: "[log in to unmask]<mailto:[log in to unmask]>" <[log in to unmask]<mailto:[log in to unmask]>>
Subject: Re: [PSCI-COM] Public engagement - why bother?
Hi Wynn,
Thanks for the example. I think I’m asking for examples of where the act of engaging with people outside of the ‘usual’ academic circles has somehow benefited the researcher doing the engaging. I guess I’m most interested in where that benefit is seen in the research that gets done (though other benefits are also interesting).
As an example, I was talking to a biologist manning an exhibition at the Royal Society Summer Science exhibition and, unprompted, she told me how a discussion with a visitor made her rethink her research direction (unfortunately, I didn’t have time to explore this with her in more detail).
Does that answer your question?
Thanks,
Patrick
Patrick Middleton
BBSRC Head of Engagement
01793 413 368 | 07771 945 529
www.bbsrc.ac.uk<http://www.bbsrc.ac.uk> | [log in to unmask]<mailto:[log in to unmask]> | @Patrick_Midd<http://www.twitter.com/Patrick_Midd>
From: psci-com: on public engagement with science [mailto:[log in to unmask]] On Behalf Of Wynn Abbott
Sent: 23 August 2012 15:58
To: [log in to unmask]<mailto:[log in to unmask]>
Subject: Re: [PSCI-COM] Public engagement - why bother?
Hi Patrick,
Your question is probably a little loaded i.e. is the question that the process of public engagement affects research, or the public interaction with the public engagement affects research?
Probably a bit hazy with most PE projects.
Anyhow, the normal example I used in science-art talks, whereby the process of science-art collaboration redirected the scientific research is the Ackroyd & Harvey collaboration with the IGER (Institute of Grassland and Environmental Research) around 2000/01. It was through the use of ‘stay-green’ genetically-modified grass that the artists and scientists came together, in creating the artists’ trademark ‘photosynthetic portraits’.
If you read the summary of the project the scientists talk about the redirection of their research as a result of the collaboration: http://www.viewingspace.com/genetics_culture/pages_genetics_culture/gc_w02/gc_w02_ackroyd_harvey.htm
Clearly this change of direction of the research would have happened independent of any actual engagement with the public. In science-art circles people often speak about the process and the final work/product/project. Not sure which you’re most interested in...
Best,
Wynn
From: psci-com: on public engagement with science [mailto:[log in to unmask]] On Behalf Of Patrick Middleton (BBSRC, SO)
Sent: 23 August 2012 15:38
To: [log in to unmask]<mailto:[log in to unmask]>
Subject: [PSCI-COM] Public engagement - why bother?
Hi all,
Help please!
I’m trying to draw together examples, anecdotes and evidence of what researchers get out of doing public engagement. If you have any examples please let me know and I’ll post them on the growing list here: http://www.scoop.it/t/public-engagement-why-bother
You often hear people say things like, “public engagement can make think about your research differently” or “talking to people helps you reassess your research questions”. But what’s the evidence for this?
I’m interested in any benefits that researchers feel they get out of doing public engagement – better people skills, improved CV, more funding, improved confidence – but I’m most interested in examples where public engagement has actually effected what research gets done.
Do you know of any research in this area or have any anecdotes to share?
Thanks,
Patrick
Patrick Middleton
BBSRC Head of Engagement
01793 413 368 | 07771 945 529
www.bbsrc.ac.uk<http://www.bbsrc.ac.uk> | [log in to unmask]<mailto:[log in to unmask]> | @Patrick_Midd<http://www.twitter.com/Patrick_Midd>
_______________________________________________________________
This email and any attachments are intended solely for the use of the individual(s) to whom it/they are addressed. If you believe you have received this in error please notify the sender and delete this e-mail from your system.
BBSRC may need to release information, including this email and any attachments therein, under the terms of the Freedom of Information or Data Protection Acts.
Opinions, conclusions or other information in this message and attachments that are not related directly to BBSRC business are solely those of the author and do not represent the views of BBSRC.
This message has been scanned by the WebRoot Email Security Service. For more information please visit http://www.webroot.com
_______________________________________________________________
********************************************************************** Further information about the psci-com discussion list, including list archive, can be found at the list web site: http://www.jiscmail.ac.uk/lists/psci-com.html You may also change your settings and subscribe/unsubscribe to psci-com from the web site.
Psci-com is part of the National Academic Mailing List Service, known as 'JISCMail'. It adheres to the JISCMail Acceptable Use Policy: http://www.jiscmail.ac.uk/policyandsecurity/acceptableuse.html and to the JISCMail guidelines for etiquette: http://www.jiscmail.ac.uk/policyandsecurity/etiquette.html
Email commands: 1. To suspend yourself from the list, whilst on leave, for example, send an email to mailto:[log in to unmask]<mailto:mailto:[log in to unmask]> with the following message:
set psci-com nomail -- [include hyphens]
2. To resume email from the list, send an email to [log in to unmask]<mailto:[log in to unmask]> with the message:
set psci-com mail -- [include hyphens]
3. To leave psci-com, send an email to [log in to unmask]<mailto:[log in to unmask]> with the message:
leave psci-com -- [include hyphens]
Please allow up to 24 hours for these commands to activate. Remember that you will need to send commands using the same email address that you used to register on psci-com. To contact the Psci-com list owner, please send an email to: [log in to unmask]<mailto:[log in to unmask]>
**********************************************************************
_______________________________________________________________ This message has been scanned by the WebRoot Email Security Service. For more information please visit http://www.webroot.com _______________________________________________________________
********************************************************************** Further information about the psci-com discussion list, including list archive, can be found at the list web site: http://www.jiscmail.ac.uk/lists/psci-com.html You may also change your settings and subscribe/unsubscribe to psci-com from the web site.
Psci-com is part of the National Academic Mailing List Service, known as 'JISCMail'. It adheres to the JISCMail Acceptable Use Policy: http://www.jiscmail.ac.uk/policyandsecurity/acceptableuse.html and to the JISCMail guidelines for etiquette: http://www.jiscmail.ac.uk/policyandsecurity/etiquette.html
Email commands: 1. To suspend yourself from the list, whilst on leave, for example, send an email to mailto:[log in to unmask]<mailto:mailto:[log in to unmask]> with the following message:
set psci-com nomail -- [include hyphens]
2. To resume email from the list, send an email to [log in to unmask]<mailto:[log in to unmask]> with the message:
set psci-com mail -- [include hyphens]
3. To leave psci-com, send an email to [log in to unmask]<mailto:[log in to unmask]> with the message:
leave psci-com -- [include hyphens]
Please allow up to 24 hours for these commands to activate. Remember that you will need to send commands using the same email address that you used to register on psci-com. To contact the Psci-com list owner, please send an email to: [log in to unmask]<mailto:[log in to unmask]>
**********************************************************************
********************************************************************** Further information about the psci-com discussion list, including list archive, can be found at the list web site: http://www.jiscmail.ac.uk/lists/psci-com.html You may also change your settings and subscribe/unsubscribe to psci-com from the web site.
Psci-com is part of the National Academic Mailing List Service, known as 'JISCMail'. It adheres to the JISCMail Acceptable Use Policy: http://www.jiscmail.ac.uk/policyandsecurity/acceptableuse.html and to the JISCMail guidelines for etiquette: http://www.jiscmail.ac.uk/policyandsecurity/etiquette.html
Email commands: 1. To suspend yourself from the list, whilst on leave, for example, send an email to mailto:[log in to unmask]<mailto:mailto:[log in to unmask]> with the following message:
set psci-com nomail -- [include hyphens]
2. To resume email from the list, send an email to [log in to unmask]<mailto:[log in to unmask]> with the message:
set psci-com mail -- [include hyphens]
3. To leave psci-com, send an email to [log in to unmask]<mailto:[log in to unmask]> with the message:
leave psci-com -- [include hyphens]
Please allow up to 24 hours for these commands to activate. Remember that you will need to send commands using the same email address that you used to register on psci-com. To contact the Psci-com list owner, please send an email to: [log in to unmask]<mailto:[log in to unmask]>
**********************************************************************
********************************************************************** Further information about the psci-com discussion list, including list archive, can be found at the list web site: http://www.jiscmail.ac.uk/lists/psci-com.html You may also change your settings and subscribe/unsubscribe to psci-com from the web site.
Psci-com is part of the National Academic Mailing List Service, known as 'JISCMail'. It adheres to the JISCMail Acceptable Use Policy: http://www.jiscmail.ac.uk/policyandsecurity/acceptableuse.html and to the JISCMail guidelines for etiquette: http://www.jiscmail.ac.uk/policyandsecurity/etiquette.html
Email commands: 1. To suspend yourself from the list, whilst on leave, for example, send an email to mailto:[log in to unmask]<mailto:mailto:[log in to unmask]> with the following message:
set psci-com nomail -- [include hyphens]
2. To resume email from the list, send an email to [log in to unmask]<mailto:[log in to unmask]> with the message:
set psci-com mail -- [include hyphens]
3. To leave psci-com, send an email to [log in to unmask]<mailto:[log in to unmask]> with the message:
leave psci-com -- [include hyphens]
Please allow up to 24 hours for these commands to activate. Remember that you will need to send commands using the same email address that you used to register on psci-com. To contact the Psci-com list owner, please send an email to: [log in to unmask]<mailto:[log in to unmask]>
**********************************************************************
********************************************************************** Further information about the psci-com discussion list, including list archive, can be found at the list web site: http://www.jiscmail.ac.uk/lists/psci-com.html You may also change your settings and subscribe/unsubscribe to psci-com from the web site.
Psci-com is part of the National Academic Mailing List Service, known as 'JISCMail'. It adheres to the JISCMail Acceptable Use Policy: http://www.jiscmail.ac.uk/policyandsecurity/acceptableuse.html and to the JISCMail guidelines for etiquette: http://www.jiscmail.ac.uk/policyandsecurity/etiquette.html
Email commands: 1. To suspend yourself from the list, whilst on leave, for example, send an email to mailto:[log in to unmask]<mailto:mailto:[log in to unmask]> with the following message:
set psci-com nomail -- [include hyphens]
2. To resume email from the list, send an email to [log in to unmask]<mailto:[log in to unmask]> with the message:
set psci-com mail -- [include hyphens]
3. To leave psci-com, send an email to [log in to unmask]<mailto:[log in to unmask]> with the message:
leave psci-com -- [include hyphens]
Please allow up to 24 hours for these commands to activate. Remember that you will need to send commands using the same email address that you used to register on psci-com. To contact the Psci-com list owner, please send an email to: [log in to unmask]<mailto:[log in to unmask]>
**********************************************************************
_______________________________________________________________
This email and any attachments are intended solely for the use of the individual(s) to whom it/they are addressed. If you believe you have received this in error please notify the sender and delete this e-mail from your system.
BBSRC may need to release information, including this email and any attachments therein, under the terms of the Freedom of Information or Data Protection Acts.
Opinions, conclusions or other information in this message and attachments that are not related directly to BBSRC business are solely those of the author and do not represent the views of BBSRC.
This message has been scanned by the WebRoot Email Security Service. For more information please visit http://www.webroot.com
_______________________________________________________________********************************************************************** Further information about the psci-com discussion list, including list archive, can be found at the list web site: http://www.jiscmail.ac.uk/lists/psci-com.html You may also change your settings and subscribe/unsubscribe to psci-com from the web site.
Psci-com is part of the National Academic Mailing List Service, known as 'JISCMail'. It adheres to the JISCMail Acceptable Use Policy: http://www.jiscmail.ac.uk/policyandsecurity/acceptableuse.html and to the JISCMail guidelines for etiquette: http://www.jiscmail.ac.uk/policyandsecurity/etiquette.html
Email commands: 1. To suspend yourself from the list, whilst on leave, for example, send an email to mailto:[log in to unmask]<mailto:mailto:[log in to unmask]> with the following message:
set psci-com nomail -- [include hyphens]
2. To resume email from the list, send an email to [log in to unmask]<mailto:[log in to unmask]> with the message:
set psci-com mail -- [include hyphens]
3. To leave psci-com, send an email to [log in to unmask]<mailto:[log in to unmask]> with the message:
leave psci-com -- [include hyphens]
Please allow up to 24 hours for these commands to activate. Remember that you will need to send commands using the same email address that you used to register on psci-com. To contact the Psci-com list owner, please send an email to: [log in to unmask]<mailto:[log in to unmask]>
**********************************************************************
**********************************************************************
Further information about the psci-com discussion list, including list archive, can be found at the list web site: http://www.jiscmail.ac.uk/lists/psci-com.html
You may also change your settings and subscribe/unsubscribe to psci-com from the web site.
Psci-com is part of the National Academic Mailing List Service, known as 'JISCMail'.
It adheres to the JISCMail Acceptable Use Policy: http://www.jiscmail.ac.uk/policyandsecurity/acceptableuse.html
and to the JISCMail guidelines for etiquette: http://www.jiscmail.ac.uk/policyandsecurity/etiquette.html
Email commands:
1. To suspend yourself from the list, whilst on leave, for example,
send an email to mailto:[log in to unmask] with the following message:
set psci-com nomail -- [include hyphens]
2. To resume email from the list, send an email to [log in to unmask] with the message:
set psci-com mail -- [include hyphens]
3. To leave psci-com, send an email to [log in to unmask] with the message:
leave psci-com -- [include hyphens]
Please allow up to 24 hours for these commands to activate.
Remember that you will need to send commands using the same email address that you used to register on psci-com.
To contact the Psci-com list owner, please send an email to: [log in to unmask]
**********************************************************************
