JiscMail Logo
Email discussion lists for the UK Education and Research communities

Help for RAMESES Archives

RAMESES Archives

RAMESES Archives













By Topic:










By Author:











Proportional Font





RAMESES  August 2013

RAMESES August 2013


Subscribe or Unsubscribe

Subscribe or Unsubscribe

Log In

Log In

Get Password

Get Password


Re: Realist Evaluation + Comparitive Effectiveness research


Rebecca Randell <[log in to unmask]>


Realist and Meta-narrative Evidence Synthesis: Evolving Standards" <[log in to unmask]>, Rebecca Randell <[log in to unmask]>


Wed, 21 Aug 2013 09:23:09 +0100





text/plain (1 lines)

Hi Justin

We are about to begin a realist process evaluation, running alongside a clinical trial comparing robotic and laparoscopic surgery for curative treatment of rectal cancer, looking at differences in teamwork, communication and decision making in the operating theatre and subsequent patient outcomes: http://www.netscc.ac.uk/hsdr/projdetails.php?ref=12-5005-04

We plan to publish the study protocol shortly.

Best wishes


Dr Rebecca Randell

Senior Translational Research Fellow

School of Healthcare

Baines Wing (room LG.05)

University of Leeds

Leeds LS2 9UT<x-apple-data-detectors://4/0>

Tel: +44 (0) 113 343 1337<tel:+44%20(0)%20113%20343%201337>

Email: [log in to unmask]<mailto:[log in to unmask]>

On 21 Aug 2013, at 10:10, "Pearson, Mark" <[log in to unmask]<mailto:[log in to unmask]>> wrote:

Hi Justin

I'm involved in a study using a realist approach to construct programme theory about collaborative care interventions for offenders with common mental health problems ('Engager II' - http://clahrc-peninsula.nihr.ac.uk/project/55-engager-ii.php). Programme theories will be used to specify the intervention and a RE framework will pilot its acceptability in practice, enabling further refinement and the development of a final intervention which will be trialled. PT development will primarily take place using realist review, with piloting at a number of sites using a realist evaluation framework (e.g. focused observation of practice, interviews with practitioners, analysis of documentation inc. 'diaries') - although there will be considerable interplay between the review and RE. The protocol for the review will be published shortly.

Best wishes


Mark Pearson PhD

Senior Research Fellow

Peninsula Technology Assessment Group (PenTAG)

University of Exeter Medical School

E: [log in to unmask]<mailto:[log in to unmask]>

T: 0044 (0) 1392 726079



From: Realist and Meta-narrative Evidence Synthesis: Evolving Standards [[log in to unmask]<mailto:[log in to unmask]>] on behalf of Joanne Rycroft-Malone [[log in to unmask]<mailto:[log in to unmask]>]

Sent: 20 August 2013 21:11

To: [log in to unmask]<mailto:[log in to unmask]>

Subject: Re: Realist Evaluation + Comparitive Effectiveness research

Dear Justin

We have been attempting to combine RE with a pragmatic trial - EU FP7 funded project - comparing 2 facilitation interventions. RE framing the process evaluation. The FIRE study-protocol published - http://www.implementationscience.com/content/7/1/25

RE component to be published next year.



Jo Rycroft-Malone

Professor of Implementation & Health Services Research

University Director of Research

Bangor University

Twitter: @jorycroftmalone

Sent from my iPad

On 20 Aug 2013, at 20:40, "Justin Jagosh, Mr" <[log in to unmask]<mailto:[log in to unmask]>> wrote:

Hi all,

I was wondering if anyone has examples of research that combines realist evaluation with comparative effectiveness research. Comparative effectiveness seems to be a broad catch-all term for research that compares two different interventions or service approaches, using an array of methodologies. It would seem quite logical to use realist concepts in a comparative study in which you collect qualitative data, construct program theory and do a CMO analysis for two separate interventions or models.

I'm also looking for examples of realist evaluations that incorporate cost comparisons as well.

thank you



Justin Jagosh, Ph.D

Canadian Institutes of Health Research Post-Doctoral Fellow

Centre for Participatory Research at McGill (PRAM)

Department of Family Medicine

McGill University

[log in to unmask]<mailto:[log in to unmask]>


Office and Mailing Address:

Rm 426 - School of Population and Public Health

Universtity of British Columbia

Vancouver, BC, V6T 1Z3



From: Realist and Meta-narrative Evidence Synthesis: Evolving Standards [[log in to unmask]<mailto:[log in to unmask]>] on behalf of Marina Buswell [[log in to unmask]<mailto:[log in to unmask]>]

Sent: July 23, 2013 8:55 AM

To: [log in to unmask]<mailto:[log in to unmask]>

Subject: Re: Realist thinking is getting me stuck not started - help

Dear Gill and Geoff,

Geoff - No I hadn't seen the training material http://www.ramesesproject.org/index.php?pr=Project_outputs#train only the papers. These are useful as I can apply the learning exercises to my work -so 'crack on with it' while reading up more.

Gill thanks for your questions. I have an in-house 'quick and dirty' evaluation which actually is a really useful insight into the underlying theory of the program by those who developed it on the ground.

Thank you both.


-----Original Message-----

From: Gill Westhorp [mailto:[log in to unmask]]

Sent: 19 July 2013 23:52

To: 'Realist and Meta-narrative Evidence Synthesis: Evolving Standards'; Marina Buswell

Subject: RE: Realist thinking is getting me stuck not started - help

Hi Marina

You're certainly at least a closet realist!! :-)   You're thinking in all the right directions, anyway.

Geoff's absolutely right about starting to develop a bit of tentative program theory.  A couple of suggestions about ways to get started:

a) Write a realist version of one of the questions you want to answer.  For example:  Rather than "Is it safe/appropriate/comparable outcomes to in hospital assessment"  perhaps something like  "In what circumstances and for whom is it safe and appropriate? In what ways are outcomes similar to and different from outcomes in hospital assessment? When it is safe, how come? When it's not comparable, how come not?"

b) Work with a handful of people who know their way around the issue (your paramedics might be good for this) and take some rough stabs about the 'realist phrases' in the questions (e.g. 'in what circumstances', 'for whom').

c) Once you've got a few rough stabs in place you can do two things... work out what evidence you'd look for in your evaluation to test this out, and take another look at the evidence you've found in your lit review to refine your rough stabs into slightly less rough (um, looking for a word to continue the analogy -  cuts???)

On another front - you can do realist analysis of qualitative data from interviews to test hypotheses, or to understand mechanisms, or to refine hypotheses before testing.  Joseph Maxwell has published on that.  I've got some unpublished material on it too which I can share if you email me directly ([log in to unmask]<mailto:[log in to unmask]>) if that's of interest.



-----Original Message-----

From: Realist and Meta-narrative Evidence Synthesis: Evolving Standards [mailto:[log in to unmask]] On Behalf Of Marina Buswell

Sent: Friday, 19 July 2013 7:55 PM

To: [log in to unmask]<mailto:[log in to unmask]>

Subject: Realist thinking is getting me stuck not started - help

Dear RAMESES people,

I’d like to ask for some help in applying a realist approach to my current work, pragmatically yet robustly. I again find that thinking about methodology (just ordered Ray's new book) is stopping me 'cracking on' (which is what I used to do when I had PCT jobs rather than a research position).

I'll introduce myself quickly. I’m Marina currently working on a project to evaluate a new acute geriatric intervention service (AGEIS) delivered by paramedics working with OT/Physios and responding to non-emergency 999 calls for older people (who have fallen or are otherwise unwell), also doing a review to ask ‘what role do ambulance services play in urgent and emergency care for people with dementia?’ But previously I’ve worked in PCTs in ‘commissioning information’ i.e. churning round SUS data into pretty charts, and health promotion (getting people to stop smoking) I’ve done my MPH and learned all the hierarchy of evidence dogma BUT before that I was an organic chemist (PhD) and this is really what shapes how I come to a problem. Observe some stuff, use the best methods out there to figure out what you’ve got, propose some mechanisms to explain how you got from your starting materials to your products. Do some more experiments to test those mechanisms and so on. I think that is the realist angle – or am I a pragmatist?

THE EVALUATION: I’ve had the conversation about what our key questions should be (with the lead paramedic and community geriatrician). They have come out like this so far, unrefined.

1.     Is it safe/appropriate/comparable outcomes to in hospital assessment

2.     Test the model – Paramedic and Therapist (compared to other falls service models)

3.     What are long-term benefits e.g. on preventing falls, hip fracture, hospital admissions, quality of life

4.     Cost-effectiveness

5.     Admission avoidance

6.     Sustainability

7.     What impact does dementia have

8.     How does the service run? What makes it ‘work’ or not?

The service started April this year and has funding until Mar 2014. So it needs to be a timely and pragmatic evaluation and almost certainly can’t show anything statistically significant around admission avoidance. My inclination is to use their in-house activity and outcomes data and do some semi-structured interviews with staff, and patients and carers if I can get appropriate ethics and access. The service sees approx. 70 people per month, with a second vehicle to start Sep 2013. I think 1,2,7&8 can be addressed in someway within the time frame and resource.

THE REVIEW: What role do ambulance services play in urgent and emergency care for people with dementia? I am stuck trying to write up our review (2 paramedics as co-reviewers) because it does not fall neatly into any particular school, it started as a traditional review conducted at the start of a project, took a systematic turn as we filtered through 5000+ titles, went unsystematic as the literature was so sparse we had half from the grey literature and were looking for ‘nuggets’, all the time reading about realist synthesis, critical interpretative synthesis… and now I’m stuck I’d love to say it’s a realist synthesis but it’s not. Calling it a 'critical scoping review' and just writing what we did and what we found.

I get the ideas of context and mechanism but still get a bit stuck round 'mid-range theory' do I have one but don't know it? In my only non-chemistry paper, I wrote this in the intro "In the ‘quit rate’ and targets-obsessed culture of stop smoking services it can be difficult to take time to reflect on why or why not programmes may be working. The aim of this research was to get a fuller understanding of the young people’s experience of smoking and quitting and how useful and appropriate the support offered was to them." http://hej.sagepub.com/content/72/4/408 I think that's early realist leanings?

Advice from those of you more experienced gratefully received. I will now try to just 'crack on' (I'm not used to having all this 'space' to think!) Thanks Marina

Marina Buswell

Research Associate (PT usually Tue, Thu, Fri) Cambridge Institute of Public Health CLAHRC - Old Age Theme

E: [log in to unmask]<mailto:[log in to unmask]>

T: +44 (0)1223 330341 / 07780 452214


Collaborations for Leadership in Applied Health Research and Care

Rhif Elusen Gofrestredig 1141565 - Registered Charity No. 1141565

Gall y neges e-bost hon, ac unrhyw atodiadau a anfonwyd gyda hi, gynnwys deunydd cyfrinachol ac wedi eu bwriadu i'w defnyddio'n unig gan y sawl y cawsant eu cyfeirio ato (atynt). Os ydych wedi derbyn y neges e-bost hon trwy gamgymeriad, rhowch wybod i'r anfonwr ar unwaith a dilewch y neges. Os na fwriadwyd anfon y neges atoch chi, rhaid i chi beidio a defnyddio, cadw neu ddatgelu unrhyw wybodaeth a gynhwysir ynddi. Mae unrhyw farn neu safbwynt yn eiddo i'r sawl a'i hanfonodd yn unig ac nid yw o anghenraid yn cynrychioli barn Prifysgol Bangor. Nid yw Prifysgol Bangor yn gwarantu bod y neges e-bost hon neu unrhyw atodiadau yn rhydd rhag firysau neu 100% yn ddiogel. Oni bai fod hyn wedi ei ddatgan yn uniongyrchol yn nhestun yr e-bost, nid bwriad y neges e-bost hon yw ffurfio contract rhwymol - mae rhestr o lofnodwyr awdurdodedig ar gael o Swyddfa Cyllid Prifysgol Bangor.

This email and any attachments may contain confidential material and is solely for the use of the intended recipient(s). If you have received this email in error, please notify the sender immediately and delete this email. If you are not the intended recipient(s), you must not use, retain or disclose any information contained in this email. Any views or opinions are solely those of the sender and do not necessarily represent those of Bangor University. Bangor University does not guarantee that this email or any attachments are free from viruses or 100% secure. Unless expressly stated in the body of the text of the email, this email is not intended to form a binding contract - a list of authorised signatories is available from the Bangor University Finance Office.

Top of Message | Previous Page | Permalink

JiscMail Tools

RSS Feeds and Sharing

Advanced Options


June 2020
May 2020
April 2020
March 2020
February 2020
January 2020
December 2019
November 2019
October 2019
September 2019
August 2019
July 2019
June 2019
May 2019
April 2019
March 2019
February 2019
January 2019
December 2018
November 2018
October 2018
September 2018
August 2018
July 2018
June 2018
May 2018
April 2018
March 2018
February 2018
January 2018
December 2017
November 2017
October 2017
September 2017
August 2017
July 2017
June 2017
May 2017
April 2017
March 2017
February 2017
January 2017
December 2016
November 2016
October 2016
September 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012
November 2012
October 2012
August 2012
July 2012
June 2012
May 2012
April 2012
February 2012
January 2012
December 2011
November 2011
October 2011
September 2011
August 2011
July 2011
June 2011
May 2011
April 2011
March 2011

JiscMail is a Jisc service.

View our service policies at https://www.jiscmail.ac.uk/policyandsecurity/ and Jisc's privacy policy at https://www.jisc.ac.uk/website/privacy-notice

For help and support help@jisc.ac.uk

Secured by F-Secure Anti-Virus CataList Email List Search Powered by the LISTSERV Email List Manager