 |
 |
PLEASE NOTE: When you click 'Reply' to any message it will be sent to all RAMESES List members. If you only want to reply to the sender please remove [log in to unmask] from the 'To:' section of your email. This may have been Kenneth Yakubu | MB.BS, FWACP (Fam Med), FMCFM, MBA-HUM, MPhil (Fam Med) PhD Student The George Institute for Global Health | AUSTRALIA Level 5, 1 King St | Newtown NSW 2042 Australia Postal Address: PO Box M201 | Missenden Rd | NSW 2050 Australia E [log in to unmask] | W www.georgeinstitute.org.au<http://www.georgeinstitute.org.au> twitter<http://twitter.com/georgeinstitute> | facebook<http://www.facebook.com/thegeorgeinstitute> | e-newsletter<http://www.georgeinstitute.org/newsletters> [cid:TGI20YrID_a85ccef9-665d-426f-aa5e-111791e1fe32.png] Ranked the top independent research organisation in Australia, The George Institute is affiliated with UNSW Sydney. The George Institute acknowledges the Gadigal People of the Eora Nation as the First Custodians of the land on which our Australia Office is situated. We pay our respect to Elders past, present and emerging. Think before printing - growing a tree takes 40 years. This email and its attachments are confidential and may be privileged. If you have received it by mistake, please notify me and destroy all copies and attachments immediately. From: Kenneth Yakubu Sent: Monday, 15 July 2019 11:20 AM To: 'Realist and Meta-narrative Evidence Synthesis: Evolving Standards' <[log in to unmask]>; 'Geoff Wong' <[log in to unmask]> Subject: RE: information regarding the use of RE Hi again, Concerning justifying the selection of studies for a RS based on the rigor, Wong et al in the article “RAMESES publication standards: realist syntheses” (BMC Medicine 2013, 11:21 http://www.biomedcentral.com/1741-7015/11/21) advocated for the use of “….quality standards appropriate to particular kinds of research to appraise documents or sections of documents; discussion and/or debate within a review team of a document’s findings; or consulting experts about technical aspects of methods or findings”. I would be grateful to get some guidance on making the judgement call on studies/documents that are focused on policy interventions (many of which might best be described as “natural experiments” or observation studies) in which the authors provide rich information that might influence the interpretation of the theory concerning mechanisms and outcomes, yet the methods employed before arriving at their recommendations may not conform to what is supported by the highest hierarchy of evidence. Do I include such studies with a note that the methods have a high risk of bias? Or should the focus be on the relevance of the theory suggested? Thanks, Yakubu From: Realist and Meta-narrative Evidence Synthesis: Evolving Standards <[log in to unmask]<mailto:[log in to unmask]>> On Behalf Of Geoff Wong Sent: Monday, 15 July 2019 5:50 AM To: [log in to unmask]<mailto:[log in to unmask]> Subject: Re: information regarding the use of RE PLEASE NOTE: When you click 'Reply' to any message it will be sent to all RAMESES List members. If you only want to reply to the sender please remove [log in to unmask]<mailto:[log in to unmask]> from the 'To:' section of your email. I would agree with Ray that penetration in to the US of realist review and realist evaluation has sadly been limited. Simon is right when he says that the CIHR have been more willing to fund realist reviews (mainly I think). Justin has been too modest and not cited the below. Ann Macaulay was the Principal Investigator, Justin the researcher and I trained the review team. Uncovering the Benefits of Participatory Research: Implications of a Realist Review for Health Research and Practice. Jagosh J, Macaulay A, Pluye P, Salsberg J, Bush P, Henderson J, Sirett E, Wong G, Cargo M, Herbert C, Seifer S, Green L, Greenhalgh T. Milbank Quarterly 2012;90:311-346 Other references you may want to consider below show the breath of the work being undertaken in Canada (and these are only the ones I am involved in). In addition, I have provided references to editorials and also a WHO methods commentary (albeit, these are more related to realist reviews). The video link is of the current Director of the UK's Health Services and Deliver Research Programme<https://www.nihr.ac.uk/funding-and-support/funding-for-research-studies/funding-programmes/health-services-and-delivery-research/>, Jo Rycroft-Malone. If you search using the word 'realist' in their portfolio of research, you will find many examples of the types of projects they have funded: https://www.journalslibrary.nihr.ac.uk/search/#/?search=realist&sitekit=true&indexname=full-index&task=search&selected_facets= Good luck! Geoff Editorials: Is complexity just too complex? Wong G. Journal of Clinical Epidemiology 2013;66:1199-1201 Knowledge synthesis approaches – spoilt for choice? Wong G Journal of Clinical Epidemiology 2016;73:8-10 Getting to grips with context and complexity − the case for realist approaches. Wong G. Gaceta Sanitaria 2017 doi.org/10.1016/j.gaceta.2017.05.010<http://doi.org/10.1016/j.gaceta.2017.05.010> Making theory from knowledge syntheses useful for public health. Wong G. Int J Public Health 2018;63(5):555-556 Realist reviews (North American Examples): How Design of Places Promotes or Inhibits Mobility of Older Adults: Realist Synthesis of 20 Years of Research. Yen I, Fandel Flood J, Thompson H, Anderson L, Wong G. J Aging Health 2014;26:1340-1372 Scaling up complex interventions: insights from a realist synthesis. Willis C, Riley B, Stockton L, Abramowicz A, Zummach D, Wong G, Robinson K, Best A. Health Research Policy and Systems 2016;14:88 Underlying mechanisms of complex interventions addressing the care of older adults with multimorbidity: a realist review. Kastner M, Hayden L, Wong G, Lai Y, Makarski J, Treister V, Chan J, Lee J, Ivers N, Holroyd-Leduc J, Straus S. BMJ Open 2019;9:e025009 Realist evaluation (North American Examples): A realist evaluation of community-based participatory research: partnership synergy, trust building and related ripple effects. Jagosh J, Bush P, Salsberg J, Macaulay A, Greenhalgh T, Wong G, Cargo M, Green L, Herbert C, Pluye P. BMC Public Health 2015;15:725 Methodological: Methods Commentary: Realist reviews in health policy and systems research. Wong G. In: Langlois E, Daniels K, Akl E, editors. Evidence Synthesis for Health Policy and Systems: A Methods Guide. Geneva: World Health Organization, 2018 On Sun, 14 Jul 2019 at 18:44, Jagosh, Justin <[log in to unmask]<mailto:[log in to unmask]>> wrote: PLEASE NOTE: When you click 'Reply' to any message it will be sent to all RAMESES List members. If you only want to reply to the sender please remove [log in to unmask]<mailto:[log in to unmask]> from the 'To:' section of your email. Anna, the reference to the CARES 2016 conference presentation about funding realist projects is here: https://www.youtube.com/watch?v=DMzVgOS9g8s [http://img.youtube.com/vi/DMzVgOS9g8s/0.jpg]<https://www.youtube.com/watch?v=DMzVgOS9g8s> CARES 2016 Conference Plenary Session III - YouTube<https://www.youtube.com/watch?v=DMzVgOS9g8s> www.youtube.com<http://www.youtube.com> Dr Jo Rycroft, Professor of Implementation and Health Services Research; Pro-Vice Chancellor for Research and Impact at Bangor University and Director of NIH... You might also link in this recent Annual Review of Public Health publication to build your argument for using realist methodology: https://www.annualreviews.org/doi/citedby/10.1146/annurev-publhealth-031816-044451 [http://www.annualreviews.org/pb-assets/assets/images/social-media/facebook-cover/publichealth_Journal_Cover_Facebook.png]<https://www.annualreviews.org/doi/citedby/10.1146/annurev-publhealth-031816-044451> Realist Synthesis for Public Health: Building an Ontologically Deep Understanding of How Programs Work, For Whom, and In Which Contexts | Annual Review of Public Health<https://www.annualreviews.org/doi/citedby/10.1146/annurev-publhealth-031816-044451> www.annualreviews.org<http://www.annualreviews.org> Realist synthesis is a literature review methodology for understanding how, for whom, and under what circumstances complex interventions function in complex environments. Using a heuristic called t... kind regards, Justin Justin Jagosh, Ph.D Honorary Research Associate Institute of Psychology, Health and Society University of Liverpool, United Kingdom www.liv.ac.uk/cares<http://www.liv.ac.uk/cares> Centre for Advancement in Realist Evaluation and Synthesis (CARES) www.realistmethodology-cares.org<http://www.realistmethodology-cares.org> ________________________________ From: Realist and Meta-narrative Evidence Synthesis: Evolving Standards <[log in to unmask]<mailto:[log in to unmask]>> on behalf of Anna Rockhill <[log in to unmask]<mailto:[log in to unmask]>> Sent: July 12, 2019 10:15 To: [log in to unmask]<mailto:[log in to unmask]> Subject: Re: information regarding the use of RE PLEASE NOTE: When you click 'Reply' to any message it will be sent to all RAMESES List members. If you only want to reply to the sender please remove [log in to unmask]<mailto:[log in to unmask]> from the 'To:' section of your email. Thank you so much RAMESES community members! I so appreciate all of the detailed and encouraging suggestions for how to make the case regarding the utilization of RE work. I've learned much of what I know from reading your posts over the past couple of years. I am inspired by your knowledge, but also by your generous spirits! Looking forward to meeting many of you in person next year in Dublin. Warmly, Anna On Thu, Jul 11, 2019 at 5:17 AM Charles Michaelis <[log in to unmask]<mailto:[log in to unmask]>> wrote: PLEASE NOTE: When you click 'Reply' to any message it will be sent to all RAMESES List members. If you only want to reply to the sender please remove [log in to unmask]<mailto:[log in to unmask]> from the 'To:' section of your email. Realist evaluation is one of the approaches recommended in the UK Government’s Magenta Book which sets out guidance on what to consider when designing an evaluation. https://www.gov.uk/government/publications/the-magenta-book Charles Michaelis UK mobile +447813 799 580 Please don't print this e-mail unless you really need to From: "Realist and Meta-narrative Evidence Synthesis: Evolving Standards" <[log in to unmask]<mailto:[log in to unmask]>> on behalf of Kim Grey <[log in to unmask]<mailto:[log in to unmask]>> Reply-To: "Realist and Meta-narrative Evidence Synthesis: Evolving Standards" <[log in to unmask]<mailto:[log in to unmask]>>, Kim Grey <[log in to unmask]<mailto:[log in to unmask]>> Date: Thursday, 11 July 2019 at 12:34 To: "[log in to unmask]<mailto:[log in to unmask]>" <[log in to unmask]<mailto:[log in to unmask]>> Subject: Re: information regarding the use of RE PLEASE NOTE: When you click 'Reply' to any message it will be sent to all RAMESES List members. If you only want to reply to the sender please remove [log in to unmask]<mailto:[log in to unmask]> from the 'To:' section of your email. Hi, here are a few ways that I know of, where RE is noted. These are influential sources that I have come across in my work role within the Australian Government, where I work on evaluation of indigenous programs. The Productivity Commission, a central Australian Govt authority, lists realist evaluation as one of five evaluation approaches. This is in a recent issues paper about an Indigenous Evaluation strategy. https://www.pc.gov.au/inquiries/current/indigenous-evaluation/issues This web site established via an international collaboration of funders covers RE. It is a curated authoritative source of information. https://www.betterevaluation.org/en/approach/realist_evaluation A recent article in the Evaluation Journal of Aust by Morton and Cook, staff of the Dept of Finance, notes the value of RE. Evaluators and the enhanced Commonwealth performance framework David Morton, Brad Cook https://journals.sagepub.com/doi/abs/10.1177/1035719X18795539 You could also look at how the Canadian Government describes RE, possibly in its Centre of Excellence resources. Kim Honorary Fellow Charles Darwin University On 11 Jul 2019, at 8:26 pm, Louise Caffrey <[log in to unmask]<mailto:[log in to unmask]>> wrote: PLEASE NOTE: When you click 'Reply' to any message it will be sent to all RAMESES List members. If you only want to reply to the sender please remove [log in to unmask]<mailto:[log in to unmask]> from the 'To:' section of your email. Hi Anna, There has been some discussion of realist methods in child welfare. For example: https://academic.oup.com/bjsw/article/33/6/803/1640923 https://www.sciencedirect.com/science/article/pii/S0190740917306424 https://www.sciencedirect.com/science/article/pii/S0190740909000851 The What Work's Centre for Children's Social Care https://whatworks-csc.org.uk/ - a network of centres focusing on various social issues in England, set up & funded by the government- has recently started to embrace realist methods, to a limited extent. This "mixed methods systematic review" of Signs of Safety is informed by realist synthesis, though it isn't a full realist synthesis: https://whatworks-csc.org.uk/research/reports/signs-of-safety-findings-from-a-mixed-methods-systematic-review-focussed-on-reducing-the-need-for-children-to-be-in-care/ Hope this helps. In line with Gill, I'd certainly recommend trawling the social work journals and key social science/social policy journals using "realist evaluation", "realist synthesis" etc search terms. All the best with your research, Louise <https://academic.oup.com/bjsw/article/33/6/803/1640923> Dr Louise Caffrey Assistant Professor in Social Policy School of Social Work and Social Policy Room: 3065 Arts Building Trinity College Dublin, the University of Dublin Dublin 2, Ireland +353 1 896 3708 Profile: http://people.tcd.ie/Profile?Username=Caffrelo ________________________________ From: Realist and Meta-narrative Evidence Synthesis: Evolving Standards <[log in to unmask]<mailto:[log in to unmask]>> on behalf of Anna Rockhill <[log in to unmask]<mailto:[log in to unmask]>> Sent: 10 July 2019 19:48:10 To: [log in to unmask]<mailto:[log in to unmask]> Subject: information regarding the use of RE PLEASE NOTE: When you click 'Reply' to any message it will be sent to all RAMESES List members. If you only want to reply to the sender please remove [log in to unmask]<mailto:[log in to unmask]> from the 'To:' section of your email. Hello- I'm in the US and hoping to help make the case for RE with some government funders. In my line of work (mostly child protection/child welfare, IPV, substance use disorder research and evaluation) essentially no one is familiar with RE/RS. I'd like to speak to the extent to which the approach is utilized and seen as legitimate in other countries, particularly in the social services realm. Can anyone point me to data or other information related to this? Thanks in advance. -Anna Rockhill Regional Research Institute Portland State University Portland Oregon To UNSUBSCRIBE please see: https://www.jiscmail.ac.uk/help/subscribers/faq.html#join To UNSUBSCRIBE please see: https://www.jiscmail.ac.uk/help/subscribers/faq.html#join To UNSUBSCRIBE please see: https://www.jiscmail.ac.uk/help/subscribers/faq.html#join To UNSUBSCRIBE please see: https://www.jiscmail.ac.uk/help/subscribers/faq.html#join To UNSUBSCRIBE please see: https://www.jiscmail.ac.uk/help/subscribers/faq.html#join To UNSUBSCRIBE please see: https://www.jiscmail.ac.uk/help/subscribers/faq.html#join To UNSUBSCRIBE please see: https://www.jiscmail.ac.uk/help/subscribers/faq.html#join To UNSUBSCRIBE please see: https://www.jiscmail.ac.uk/help/subscribers/faq.html#join