Hello SueIn re-reading your question, I wonder if there is any guidance to be derived from a mesh of the tenets of qualitative research with program evaluation.
The financial comptrollers tend to lean on quantitative approaches which has stymied the field since the work is not readily quantifiable. In these times of economic restraint, the push towards using business tools and models to explain the value of social and community services only brings anxiety to the field and tends to paralyze the efforts to communicate the benefits.
In the past, I recommended the use of photo or video presentations to provide a chronology of the outcomes. Certainly the question of privacy mitigates against such an approach, but one wonders if the popularity of such social media as YouTube could be used to garner the public (aka political) support necessary to ensure the ongoing funding from governmental or other sources.
I don't presume any expertise in qualitative research methodology, but this area was an interest of mine and so I accumulated some resources on the subject. Some which might be of use include (in no particular order):
(This article introduces the symposium issue on ‘Narrative, Numbers and Socio-Cultural Change’. The articles were all papers presented initially at the conference ‘Narrative, Numbers and Social Change’ at the University of Manchester, UK in November 2007. The conference was organized through the Economic and Social Research Council (ESRC) funded Centre for Research on Socio-Cultural Change (CRESC). -
http://www.cresc.ac.uk/ CRESC looks like a good source for assistance in this area.
4. Qualitative Data Analysis and Interpretation in Counseling Psychology: Strategies for Best Practices, Christine J. Yeh and Arpana G. Inman, The Counseling Psychologist 2007; 35; 369,
http://tcp.sagepub.com/cgi/content/abstract/35/3/369 (This provides an example. On page 389, the following quote seems relevant:
Deconstructing evidence refers to an examination and reexamination of the data, refining and modifying the data at multiple levels of complexity (individual, group) in order to locate the main essence or meaning underlying the volumes of data. The objective of qualitative analysis is to determine patterns, themes, relationships, and assumptions that inform the research about the participant’s view of the world in general and about the topic in particular (McCracken, 1988). A major method of data analysis in qualitative research is coding.)
6. Quality in Qualitative Evaluation: Issues and Possible Answers, Jeane W. Anastas, Research on Social Work Practice, Vol. 14 No. 1, January 2004 57-65
7. Children’s Key Concerns: Piloting a Qualitative Approach to Understanding Their Experience of Mental Health Care, CRISPIN DAY + MARTIN CAREY + TAMMY SURGENOR, Clinical Child Psychology and Psychiatry, 2006 Vol 11(1): 139–155. DOI: 10.1177/1359104506056322
www.sagepublications.com8. Engaging New Audiences: Translating Research Into Popular Media, Yen Yen Joyceln Woo, Educational Researcher, Vol. 37, No. 6, pp. 321–329, DOI: 10.3102/0013189X08324229 © 2008 AERA.
http://er.aera.net9. Qualitative Research: Current and Best Practices, Robert T. Carter and Susan L. Morrow, The Counseling Psychologist 2007; 35; 205,
http://tcp.sagepub.com
Further information can be found at Qualitative Health Research (QHR), a peer-reviewed monthly journal that provides an international, interdisciplinary forum to enhance health care and further the development and understanding of qualitative research in health-care settings. QHR is an invaluable resource for researchers and academics, administrators and others in the health and social service professions, and graduates who seek examples of qualitative methods.
http://qhr.sagepub.com
There are likely others in this discussion group who are more suited to providing an overview of the qualitative research methodologies and whether the principles could be used for developing impact measurement tools. Perhaps this work has already been done; after all it's unlikely that my suggestion is a new idea. Hopefully others will contribute to this discussion and provide a better way of understanding and approaching this area of concern.
Thanks
-- Duncan
--------------------------------------------------------
Duncan H. Blackman, BA (Honours Certificate), MA
(Retired Consultant, Moose Jaw, SK, Canada)
--------------------original message----------------------
: Mon, 4 Apr 2011 09:42:42 +0100
From: Sue Porter <[log in to unmask]>
Subject: Re: Impact measurement tools
Hello all,
Forgive my periods of silence, as the originator of the question, as I'm
on leave at the moment, and trying to get some writing done too.
I just wanted to say how much I appreciate the thoughtful debate going on
around this question, and to re-emphasise the original framing of the
challenge; that is measuring impact within the context of understandings
of the social definitions of disability. This, hopefully seeks to take us
beyond simple individual experience and a customer/consumer relationship
within a market. Yet in the current political situation the struggle is to
reconcile this with political drivers ---
It feels very hard to keep open an understanding of economics that is
beyond just the financial, and of capital that includes social and
physical capitals (Bordieu).
In the meantime I continue to seek to find ways to use narratives as a
starting point.
Thanks again for thinking aloud.
Best wishes,
Sue
Sue Porter
Research Fellow
Norah Fry Research Centre
University of Bristol
This Disability-Research Discussion list is managed by the Centre for Disability Studies at the University of Leeds (www.leeds.ac.uk/disability-studies).
Enquiries about list administration should be sent to [log in to unmask]
Archives and tools are located at: www.jiscmail.ac.uk/lists/disability-research.html
You can VIEW, POST, JOIN and LEAVE the list by logging in to this web page.
