Print

Print


Hello Sue
In re-reading your question, I wonder if there is any guidance to be derived
from a mesh of the tenets of qualitative research with program evaluation.
The financial comptrollers tend to lean on quantitative approaches which has
stymied the field since the work is not readily quantifiable. In these times
of economic restraint, the push towards using business tools and models to
explain the value of social and community services only brings anxiety to
the field and tends to paralyze the efforts to communicate the benefits.

In the past, I recommended the use of photo or video presentations to
provide a chronology of the outcomes. Certainly the question of privacy
mitigates against such an approach, but one wonders if the popularity of
such social media as YouTube could be used to garner the public (aka
political) support necessary to ensure the ongoing funding from governmental
or other sources.

I don't presume any expertise in qualitative research methodology, but this
area was an interest of mine and so I accumulated some resources on the
subject. Some which might be of use include (in no particular order):
1. Text Mining in Qualitative Research: Application of an Unsupervised
Learning Method, by Nina Janasik, Timo Honkela and Henrik
Bruun, Organizational Research Methods 2009; 12; 436,
http://orm.sagepub.com/cgi/content/abstract/12/3/436
2. Paradigms Lost and Pragmatism Regained: Methodological Implications
of Combining Qualitative and Quantitative Methods, David L. Morgan, Journal
of Mixed Methods Research 2007; 1; 48,
http://mmr.sagepub.com/cgi/content/abstract/1/1/48
3. Introduction: Rethinking Qualitative and Quantitative Methods, Shinobu
Majima and Niamh Moore, Cultural Sociology 2009; 3; 203,
http://cus.sagepub.com/cgi/content/abstract/3/2/203
(This article introduces the symposium issue on ‘Narrative, Numbers and
Socio-Cultural Change’. The articles were all papers presented initially at
the conference ‘Narrative, Numbers and Social Change’ at the University of
Manchester, UK in November 2007. The conference was organized through the
Economic and Social Research Council (ESRC) funded Centre for Research on
Socio-Cultural Change (CRESC). - http://www.cresc.ac.uk/  CRESC looks like a
good source for assistance in this area.
4. Qualitative Data Analysis and Interpretation in Counseling Psychology:
Strategies for Best Practices, Christine J. Yeh and Arpana G. Inman, The
Counseling Psychologist 2007; 35; 369,
http://tcp.sagepub.com/cgi/content/abstract/35/3/369 (This provides an
example. On page 389, the following quote seems relevant:
Deconstructing evidence refers to an examination and reexamination of the
data, refining and modifying the data at multiple levels of
complexity (individual, group) in order to locate the main essence or
meaning underlying the volumes of data. The objective of qualitative
analysis is to determine patterns, themes, relationships, and assumptions
that inform the research about the participant’s view of the world in
general and about the topic in particular (McCracken, 1988). A major method
of data analysis in qualitative research is coding.)
5. Effectively Communicating Qualitative Research, Joseph G. Ponterotto and
Ingrid Grieger, The Counseling Psychologist 2007; 35; 404,
http://tcp.sagepub.com/cgi/content/abstract/35/3/404
6. Quality in Qualitative Evaluation: Issues and Possible Answers, Jeane W.
Anastas, Research on Social Work Practice, Vol. 14 No. 1, January 2004 57-65
7. Children’s Key Concerns: Piloting a Qualitative Approach to Understanding
Their Experience of Mental Health Care, CRISPIN DAY + MARTIN CAREY + TAMMY
SURGENOR, Clinical Child Psychology and Psychiatry, 2006  Vol 11(1):
139–155. DOI: 10.1177/1359104506056322 www.sagepublications.com
8. Engaging New Audiences: Translating Research Into Popular Media, Yen Yen
Joyceln Woo, Educational Researcher, Vol. 37, No. 6, pp. 321–329, DOI:
10.3102/0013189X08324229 © 2008 AERA. http://er.aera.net
9. Qualitative Research: Current and Best Practices, Robert T. Carter and
Susan L. Morrow, The Counseling Psychologist 2007; 35; 205,
http://tcp.sagepub.com
10. Qualitative Health Research in the Era of Evidence-Based Practice, Maria
H. F. Grypdonck, Qual Health Res 2006; 16; 1371,
http://qhr.sagepub.com/cgi/content/abstract/16/10/1371

Further information can be found at Qualitative Health Research (QHR), a
peer-reviewed monthly journal that provides an international,
interdisciplinary forum to enhance health care and further the development
and understanding of qualitative research in health-care settings. QHR is an
invaluable resource for researchers and academics, administrators and others
in the health and social service professions, and graduates who seek
examples of qualitative methods. http://qhr.sagepub.com

There are likely others in this discussion group who are more suited to
providing an overview of the qualitative research methodologies and whether
the principles could be used for developing impact measurement tools.
Perhaps this work has already been done; after all it's unlikely that my
suggestion is a new idea. Hopefully others will contribute to this
discussion and provide a better way of understanding and approaching this
area of concern.

Thanks
-- Duncan
--------------------------------------------------------
Duncan H. Blackman, BA (Honours Certificate), MA
(Retired Consultant, Moose Jaw, SK, Canada)
Duncan’s cello recordings:
*http://www.muziboo.com/dhblack01/*<http://www.muziboo.com/dhblack01/>


--------------------original message----------------------

:    Mon, 4 Apr 2011 09:42:42 +0100
From:    Sue Porter <[log in to unmask]>
Subject: Re: Impact measurement tools

Hello all,
Forgive my periods of silence, as the originator of the question, as I'm
on leave at the moment, and trying to get some writing done too.

I just wanted to say how much I appreciate the thoughtful debate going on
around this question, and to re-emphasise the original framing of the
challenge; that is measuring impact within the context of understandings
of the social definitions of disability. This, hopefully seeks to take us
beyond simple individual experience and a customer/consumer relationship
within a market. Yet in the current political situation the struggle is to
reconcile this with political drivers ---

It feels very hard to keep open an understanding of economics that is
beyond just the financial, and of capital that includes social and
physical capitals (Bordieu).

In the meantime I continue to seek to find ways to use narratives as a
starting point.
Thanks again for thinking aloud.

Best wishes,

Sue

Sue Porter
Research Fellow
Norah Fry Research Centre
University of Bristol

________________End of message________________

This Disability-Research Discussion list is managed by the Centre for Disability Studies at the University of Leeds (www.leeds.ac.uk/disability-studies).

Enquiries about list administration should be sent to [log in to unmask]

Archives and tools are located at: www.jiscmail.ac.uk/lists/disability-research.html

You can VIEW, POST, JOIN and LEAVE the list by logging in to this web page.