JiscMail Logo
Email discussion lists for the UK Education and Research communities

Help for EVIDENCE-BASED-HEALTH Archives


EVIDENCE-BASED-HEALTH Archives

EVIDENCE-BASED-HEALTH Archives


EVIDENCE-BASED-HEALTH@JISCMAIL.AC.UK


View:

Message:

[

First

|

Previous

|

Next

|

Last

]

By Topic:

[

First

|

Previous

|

Next

|

Last

]

By Author:

[

First

|

Previous

|

Next

|

Last

]

Font:

Proportional Font

LISTSERV Archives

LISTSERV Archives

EVIDENCE-BASED-HEALTH Home

EVIDENCE-BASED-HEALTH Home

EVIDENCE-BASED-HEALTH  November 2014

EVIDENCE-BASED-HEALTH November 2014

Options

Subscribe or Unsubscribe

Subscribe or Unsubscribe

Log In

Log In

Get Password

Get Password

Subject:

Re: How do you define a systematic review, meta-analysis and IPD?

From:

Juan Gérvas <[log in to unmask]>

Reply-To:

Juan Gérvas <[log in to unmask]>

Date:

Wed, 19 Nov 2014 22:20:07 +0100

Content-Type:

text/plain

Parts/Attachments:

Parts/Attachments

text/plain (543 lines)

-Tom asked just about definitions
-but of course, the best definition depends of the objective of the activity
-answering a research question is only an "intermediate" objective
-if we like to inform clinicians in their daily work with the objective 
of improving decisions that help in improving the health of individual 
patients is totally different that when you like to help public health 
officers, or managers, o politicians, o lay persons
-for example, thinking in clinicians working with individual patients
1. A systematic review (also systematic literature review or structured 
literature review,
SLR) is a literature review focused on a research question that tries to 
identify,
appraise, select and synthesize all high quality research evidence 
relevant to that
question AND PRESENT IT IN SUCH A WAY THAT HELPS CLINICIANS IN THEIR 
DAILY WORK
-it is harder to produce "evidence" when you think in "final" objetives
-un saludo
-juan gérvas

El 19/11/2014 21:27, David P. Dillard escribió:
>
>
> There is another issue here in the creation of very thorough 
> literature reviews, be they called a meta analysis or a systematic 
> review or whatever.  Access to literature and the indexing of 
> literature varies with the institutional affiliations of the 
> individual who produces bibliographic content and the time on task one 
> can spend in searching different databases to find content.  I my 
> public health guide I list the databases I suggest as useful for 
> public health, and seperately for social work and yet another list of 
> databases for finding statistical content. These are each very large 
> lists and I even show in the social work section the number of hits in 
> databases for a group of scoial work phrases.
>
> http://guides.temple.edu/c.php?g=78651&p=1090522
>
> To search a group of the "best" of these databases and find citations 
> in each to quality sources for the bibliography being constructed as 
> well as weeding out duplication of the same citations from different 
> databases is going to be a huge and very time consuming process, 
> assuming there is a substantial body of literature on the topic of the 
> bibliography. Hence the thoroughness of the bibliography may be 
> limited due to the need of the producer to have the time to lead a 
> normal life as well.
>
> I am finding this discussion to be most helpful and informative and I 
> greatly thank all of you who have been contributing.  I also would 
> point out that often on topic content can often be found about a 
> subject from databases that may seem completely unrelated to the 
> subject of a research topic or bibliography.
>
>
> .
>
>
> Sincerely,
> David Dillard
> Temple University
> (215) 204 - 4584
> [log in to unmask]
>
> Net-Gold
> http://groups.yahoo.com/group/net-gold
> http://listserv.temple.edu/archives/net-gold.html
> https://groups.io/org/groupsio/Net-Gold/archives
> http://net-gold.3172864.n2.nabble.com/
>
>
> SPORT-MED
> https://www.jiscmail.ac.uk/lists/sport-med.html
> http://groups.yahoo.com/group/sports-med/
> http://listserv.temple.edu/archives/sport-med.html
>
>
>
> On Wed, 19 Nov 2014, Dean Giustini wrote:
>
>> Hi Susan, Jon and others,
>> Recently, I have asked myself similar questions about 
>> expert/exhaustive searches. For example: What evidence is there that
>> exhaustive searches result in better research? more reliable 
>> research? What proof is there that this is true?
>>
>> For example, this paper was published recently:
>>  *  Li L, Tian J, Tian H, et al. Network meta-analyses could be 
>> improved by searching more sources and by involving a
>>     librarian. J Clin Epidemiol. 2014 Sep;67(9):1001-1007. 
>> http://www.ncbi.nlm.nih.gov/pubmed/24841794
>>
>> As an information professional, I was exciting to read that network 
>> meta-analyses can be improved by searching in more sources
>> and involving a librarian. I was hoping to read an evaluation of 
>> whether improved "better searches" changed the results of the
>> meta-analysis. But the authors could have looked at these studies, 
>> looked at the search strategies, improved them with "more
>> sources and a librarian" and then checked to see if the improvements 
>> changed the results.
>>
>>
>> That's the type of evidence I would like to see...
>>
>> Dean Giustini, MLS, MEd
>> UBC Biomedical Branch Librarian
>> Diamond Health Care Centre, VGH
>> 2775 Laurel Street, Vancouver BC
>> t: 604.875.4505
>> [log in to unmask]
>> @giustini
>>
>> On 19 November 2014 08:53, Susan Fowler 
>> <[log in to unmask]> wrote:
>>       For evidence I refer you to the guidelines offered by Cochrane, 
>> PRISMA, and IOM. They list the evidence that
>>       supports their recommendations for thorough searching.
>>
>> On Wed, Nov 19, 2014 at 10:39 AM, Jon Brassey 
>> <[log in to unmask]> wrote:
>>       Hi Susan,
>>
>> I would love to see some evidence around all this.  You say 'should 
>> do a more exhaustive search' - what is that
>> based on?
>>
>> There have recently been a number of studies that demonstrate 
>> undertaking a meta-analysis using only a sample of
>> published trials (via modified search protocols) makes little 
>> difference (typically compared with a Cochrane
>> systematic review).
>>
>> Are you aware of any studies that have shown just doing a Medline 
>> search alters the outcome of a meta-analysis
>> based on a 'full' systematic review.  I'm aware of studies that show 
>> that you miss trials by focusing on Medline -
>> but I'm not sure how often that leads to an altered outcome. It'd be 
>> a fascinating read.
>>
>> Thanks in advance.
>>
>> jon
>>
>>
>>
>> On Wed, Nov 19, 2014 at 4:24 PM, Susan Fowler 
>> <[log in to unmask]> wrote:
>>       I didn't mean to sound so extreme. Of course we cannot find it 
>> all but we should do a more exhaustive
>>       search then just medline and we should include grey lit 
>> resources. To me, if neither of those things
>>       have been attempted - searching more then medline and searching 
>> grey lit, I would not define it as a
>>       systematic review.
>> I believe definitions like,...
>>
>>       A Systematic review “attempts to collate all empirical evidence 
>> that fits pre-specified
>>       eligibility criteria in order to answer a specific research 
>> question.  It uses explicit,
>>       systematic methods that are selected with a view to minimizing 
>> bias, thus providing more
>>       reliable findings from which conclusions can be drawn and 
>> decisions made.”   Higgins JPT, Green
>>       S (editors). Cochrane Handbook for Systematic Reviews of 
>> Interventions Version 5.1.0 [updated
>>       March 2011]. The Cochrane Collaboration, 2011. Available from 
>> www.cochrane-handbook.org.,
>>       Section 1.2.2
>>
>>
>> specifies attempts for good reason. Researchers should to attempt to 
>> collate all empirical evidence knowing
>> they will not be able to but also knowing that they have to do more 
>> then search medline.
>>
>>
>>
>>
>>
>> Susan
>>
>> On Wed, Nov 19, 2014 at 10:07 AM, Jon Brassey 
>> <[log in to unmask]> wrote:
>>       I am unaware of any systematic review that gets ALL the studies 
>> and I don't believe there is any
>>       way of telling if you've got them all or not.  As we now know 
>> (via AllTrials) is that
>>       approximately 30-50% of trials are unpublished - many/most of 
>> these unpublished trials are
>>       invisible to typical SR methods.
>>
>> If people search multiple databases and assume they find all trials 
>> that's simply wrong and
>> potentially dangerous.  They may have found ALL published trials but 
>> that's entirely different from
>> ALL trials.
>>
>> I often work through the numbers to illustrate the issue.  Assume 
>> there have been 20 trials and that
>> 40% (8 trials) have not been published.  A search of Medline might 
>> find 10 of the 12 published trials
>> and an exhaustive search of multiple databases might find the other 2.
>>
>> So, a Medline systematic review is based on a sample of 10/20 trials 
>> (a 50% sample) while an
>> exhaustive search might be based on 12/20 (60% sample).  I'd love to 
>> see some cost-benefit figures
>> around this.  In other words, are the extra 2 trials worth the 
>> massive increase in database search
>> time.
>>
>> Best wishes
>>
>> jon
>>
>>
>>
>> On Wed, Nov 19, 2014 at 3:05 PM, Susan Fowler 
>> <[log in to unmask]> wrote:
>>       If a "systematic review" reports only searching medline, it is 
>> NOT a systematic review
>>       because the researchers have not collected ALL the studies that 
>> relate to their question.
>> -- 
>> Susan Fowler, MLIS
>> Medical Librarian
>> Coordinator, Systematic Review Services
>>
>> Evidence at Becker:
>> http://beckerguides.wustl.edu/ebm
>>
>> Systematic Reviews Guide:
>> http://beckerguides.wustl.edu/SystematicReviews
>>
>> Becker Medical Library, Washington University in St. Louis
>> 314-362-8092
>> [log in to unmask]
>>
>> On Wed, Nov 19, 2014 at 8:25 AM, Ansari, Mohammed <[log in to unmask]> 
>> wrote:
>>
>>       Hi Tom,
>>
>>
>>
>>       My understanding is only mine based on experience – I pen them 
>> down not looking at
>>       the definitions you provide. Qualitatively each one of these is 
>> on a continuum
>>       ---sometimes so poor that some may consider them not to be what 
>> they claim to be. So
>>       actually it’s a matter of where one places their defining 
>> cut-off. Like sensitivity
>>       and specificity there will be trade-offs. When we screen in SRs 
>> at abstract level we
>>       consider the following criteria:
>>
>>
>>
>>       At least reports:
>>
>>       A research question/purpose
>>
>>       Searching Medline
>>
>>       Last search date
>>
>>       And attempts to answer the question based on primary literature
>>
>>
>>
>>       At full text level:
>>
>>       Implicitly or explicitly indicate screening the search output 
>> against some
>>       eligibility criteria
>>
>>       Implicitly or explicitly appraise the validity and 
>> applicability of studies
>>       (separating RCT from observational studies counts as some 
>> modicum of appraisal)
>>
>>       Synthesizes results to reach a bottom line – not just 
>> descriptive paragraph by
>>       paragraph summary of what X, Y and Z et al…
>>
>>       Uses assessment of critical appraisal in synthesizing results 
>> to provide the best
>>       available synthesis
>>
>>
>>
>>       Meta-analysis:
>>
>>       Statistical pooling of study summary data
>>
>>
>>
>>       IPD:
>>
>>       Statistical pooling of raw data from more than one study
>>
>>
>>
>>       From: Evidence based health (EBH) 
>> [mailto:[log in to unmask]] On
>>       Behalf Of Tom Jefferson
>>       Sent: Wednesday, November 19, 2014 6:25 AM
>>       To: [log in to unmask]
>>       Subject: How do you define a systematic review, meta-analysis 
>> and IPD?
>>
>>
>>
>>       Dear list members, I would be grateful if you could give me 
>> your views on the
>>       definitions of what constitutes a systematic review, 
>> meta-analysis and IPD. I have
>>       reported below definitions from the most popular sources of 
>> information (highest
>>       Google algorithm position). I have numbered each definition 1 
>> to 6 for ease of
>>       commenting.
>>       Thanks for your time.
>>
>>
>> Systematic review - Wikipedia:
>>
>>
>> 1. A systematic review (also systematic literature review or 
>> structured literature review,
>> SLR) is a literature review focused on a research question that tries 
>> to identify,
>> appraise, select and synthesize all high quality research evidence 
>> relevant to that
>> question
>>
>> and
>>
>> A systematic review aims to provide an exhaustive summary of current 
>> literature relevant
>> to a research question. The first step of a systematic review is a 
>> thorough search of the
>> literature for relevant papers. The Methodology section of the review 
>> will list the
>> databases and citation indexes searched, such as Web of Science, 
>> Embase, and PubMed, as
>> well as any hand searched individual journals. Next, the titles and 
>> the abstracts of the
>> identified articles are checked against pre-determined criteria for 
>> eligibility and
>> relevance. This list will always depend on the research problem. Each 
>> included study may
>> be assigned an objective assessment of methodological quality 
>> preferably using a method
>> conforming to the Preferred Reporting Items for Systematic Reviews 
>> and Meta-Analyses
>> (PRISMA) statement (the current guideline)[5] or the high quality 
>> standards of Cochrane
>> collaboration.[6]
>>
>> (https://en.wikipedia.org/wiki/Systematic_review)
>>
>> Systematic review - Cochrane/PRISMA:
>>
>> 2. A systematic review is a review of a clearly formulated question 
>> that uses systematic
>> and explicit methods to identify, select, and critically appraise 
>> relevant research, and
>> to collect and analyze data from the studies that are included in the 
>> review. Statistical
>> methods (meta-analysis) may or may not be used to analyze and 
>> summarize the results of the
>> included studies. Meta-analysis refers to the use of statistical 
>> techniques in a
>> systematic review to integrate the results of included studies.
>>
>> (http://www.cochrane.org/glossary/5#letters)
>>
>>
>>
>> Meta-analysis - Wikipedia
>>
>> 3. In statistics, meta-analysis comprises statistical methods for 
>> contrasting and
>> combining results from different studies in the hope of identifying 
>> patterns among study
>> results, sources of disagreement among those results, or other 
>> interesting relationships
>> that may come to light in the context of multiple studies.[1] 
>> Meta-analysis can be thought
>> of as "conducting research about previous research." In its simplest 
>> form, meta-analysis
>> is done by identifying a common statistical measure that is shared 
>> between studies, such
>> as effect size or p-value, and calculating a weighted average of that 
>> common measure. This
>> weighting is usually related to the sample sizes of the individual 
>> studies, although it
>> can also include other factors, such as study quality.
>>
>> (https://en.wikipedia.org/wiki/Meta-analysis)
>>
>> Meta-analysis - Cochrane
>>
>> 4. The use of statistical techniques in a systematic review to 
>> integrate the results of
>> included studies. Sometimes misused as a synonym for systematic 
>> reviews, where the review
>> includes a meta-analysis.
>>
>> (http://www.cochrane.org/glossary/5#letterm)
>>
>> Individual patient data (IPD) - Cochrane
>>
>> 5. Individual patient data [In meta-analysis:] The availability of 
>> raw data for each study
>> participant in each included study, as opposed to aggregate data 
>> (summary data for the
>> comparison groups in each study). Reviews using individual patient 
>> data require
>> collaboration of the investigators who conducted the original 
>> studies, who must provide
>> the necessary data.
>>
>> (http://www.cochrane.org/glossary/5#letteri)
>>
>>
>> Individual patient data (IPD) - Bandolier
>>
>> 6. In systematic reviews this term refers to the availability of raw 
>> data for each study
>> participant in each included trial, as opposed to aggregate data 
>> (summary data for the
>> comparison groups in each study). Reviews using individual patient 
>> data require
>> collaboration of the investigators who conducted the original trials, 
>> who must provide the
>> necessary data.
>>
>> (http://www.medicine.ox.ac.uk/bandolier/booth/glossary/individual.html)
>>
>> -- 
>>
>> Dr Tom Jefferson
>> Medico Chirurgo
>> GMC # 2527527
>>
>> ______________________________________________________________________________________________________________________________ 
>>
>>
>> Confidentiality Statement - The contents of this e-mail, including 
>> its attachment, are
>> intended for the exclusive use of the recipient and may contain 
>> confidential or privileged
>> information.  If you are not the intended recipient, you are strictly 
>> prohibited from
>> reading, using, disclosing, copying, or distributing this e-mail or 
>> any of its contents.
>> If you received this e-mail in error, please notify the sender by 
>> reply e-mail immediately
>> or the Privacy Office ([log in to unmask]) and permanently 
>> delete this e-mail
>> and its attachments, along with any copies thereof.  Thank you.
>>
>>
>>
>> Avis de confidentialité – Ce courriel, y compris ses pièces jointes, 
>> s’adresse au
>> destinataire uniquement et pourrait contenir des renseignements 
>> confidentiels. Si vous
>> n’êtes pas le bon destinataire, il est strictement interdit de lire, 
>> d’utiliser, de
>> divulguer, de copier ou de diffuser ce courriel ou son contenu, en 
>> partie ou en entier. Si
>> vous avez reçu ce courriel par erreur, veuillez en informer 
>> immédiatement l’expéditeur ou
>> le bureau de la Protection des renseignements personnels
>> ([log in to unmask]), puis effacez le courriel ainsi que 
>> les pièces jointes
>> et toute autre copie. Merci.
>>
>> ______________________________________________________________________________________________________________________________ 
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> -- 
>> Jon Brassey
>> Trip Database
>> http://www.tripdatabase.com
>> Find evidence fast
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> -- 
>> Jon Brassey
>> Trip Database
>> http://www.tripdatabase.com
>> Find evidence fast
>>
>>
>>
>>
>>
>> -- 
>> Susan Fowler, MLIS
>> Medical Librarian
>> Coordinator, Systematic Review Services
>>
>> Evidence at Becker:
>> http://beckerguides.wustl.edu/ebm
>>
>> Systematic Reviews Guide:
>> http://beckerguides.wustl.edu/SystematicReviews
>>
>> Becker Medical Library, Washington University in St. Louis
>> 314-362-8092
>> [log in to unmask]
>>
>>
>>
>>
>>


---
Este mensaje no contiene virus ni malware porque la protección de avast! Antivirus está activa.
http://www.avast.com

Top of Message | Previous Page | Permalink

JiscMail Tools


RSS Feeds and Sharing


Advanced Options


Archives

April 2024
March 2024
February 2024
January 2024
December 2023
November 2023
October 2023
September 2023
August 2023
July 2023
June 2023
May 2023
April 2023
March 2023
February 2023
January 2023
December 2022
November 2022
October 2022
September 2022
August 2022
July 2022
June 2022
May 2022
April 2022
March 2022
February 2022
January 2022
December 2021
November 2021
October 2021
September 2021
August 2021
July 2021
June 2021
May 2021
April 2021
March 2021
February 2021
January 2021
December 2020
November 2020
October 2020
September 2020
August 2020
July 2020
June 2020
May 2020
April 2020
March 2020
February 2020
January 2020
December 2019
November 2019
October 2019
September 2019
August 2019
July 2019
June 2019
May 2019
April 2019
March 2019
February 2019
January 2019
December 2018
November 2018
October 2018
September 2018
August 2018
July 2018
June 2018
May 2018
April 2018
March 2018
February 2018
January 2018
December 2017
November 2017
October 2017
September 2017
August 2017
July 2017
June 2017
May 2017
April 2017
March 2017
February 2017
January 2017
December 2016
November 2016
October 2016
September 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012
November 2012
October 2012
September 2012
August 2012
July 2012
June 2012
May 2012
April 2012
March 2012
February 2012
January 2012
December 2011
November 2011
October 2011
September 2011
August 2011
July 2011
June 2011
May 2011
April 2011
March 2011
February 2011
January 2011
December 2010
November 2010
October 2010
September 2010
August 2010
July 2010
June 2010
May 2010
April 2010
March 2010
February 2010
January 2010
December 2009
November 2009
October 2009
September 2009
August 2009
July 2009
June 2009
May 2009
April 2009
March 2009
February 2009
January 2009
December 2008
November 2008
October 2008
September 2008
August 2008
July 2008
June 2008
May 2008
April 2008
March 2008
February 2008
January 2008
December 2007
November 2007
October 2007
September 2007
August 2007
July 2007
June 2007
May 2007
April 2007
March 2007
February 2007
January 2007
December 2006
November 2006
October 2006
September 2006
August 2006
July 2006
June 2006
May 2006
April 2006
March 2006
February 2006
January 2006
December 2005
November 2005
October 2005
September 2005
August 2005
July 2005
June 2005
May 2005
April 2005
March 2005
February 2005
January 2005
December 2004
November 2004
October 2004
September 2004
August 2004
July 2004
June 2004
May 2004
April 2004
March 2004
February 2004
January 2004
December 2003
November 2003
October 2003
September 2003
August 2003
July 2003
June 2003
May 2003
April 2003
March 2003
February 2003
January 2003
December 2002
November 2002
October 2002
September 2002
August 2002
July 2002
June 2002
May 2002
April 2002
March 2002
February 2002
January 2002
December 2001
November 2001
October 2001
September 2001
August 2001
July 2001
June 2001
May 2001
April 2001
March 2001
February 2001
January 2001
December 2000
November 2000
October 2000
September 2000
August 2000
July 2000
June 2000
May 2000
April 2000
March 2000
February 2000
January 2000
December 1999
November 1999
October 1999
September 1999
August 1999
July 1999
June 1999
May 1999
April 1999
March 1999
February 1999
January 1999
December 1998
November 1998
October 1998
September 1998


JiscMail is a Jisc service.

View our service policies at https://www.jiscmail.ac.uk/policyandsecurity/ and Jisc's privacy policy at https://www.jisc.ac.uk/website/privacy-notice

For help and support help@jisc.ac.uk

Secured by F-Secure Anti-Virus CataList Email List Search Powered by the LISTSERV Email List Manager