Julie et al,

A recurring issue here at this teaching hospital is what databases to
search first for the 'scoping' part of a SR. To try to answer this
definitively in some quantitative way, we did the following study in
orthopaedic surgery:

- Slobogean et al. "MEDLINE, EMBASE, and Cochrane index most primary
studies but not abstracts included in orthopedic meta-analyses."
J Clin Epidemiol. 2009 Apr 11.


My sense is that as the web scales up in size, including open access
journals unindexed, this will change. However we were looking at SRs
published in a niche area from 1995-2005. Our conclusion is that MEDLINE,
EMBASE and the Cochrane Library index more than 90% of the primary studies
in the one area we studied.

Dean Giustini
UBC Biomedical Librarian
http://blogs.ubc.ca/dean


On Wed, 22 Apr 2009, Julie Glanville wrote:

> Paul's email reminds me of a discussion maybe a year ago on this list when
> the list discussed which resources to search first to find out whether
> systematic reviews had been conducted (Cochrane Library first etc) and
> whether there were gaps in the evidence - the details are in the list
> archive, but if anyone is interested I can dig them out. The CENTRAL
> (trials) database on the Cochrane Library along with a search of MEDLINE and
> EMBASE over the last three years (to fill in for publication lags in
> CENTRAL) is also a very quick easy way to identify trials on a topic,
> especially once you have determined your PICO.
>
> There is also a resource called DUETS (http://www.library.nhs.uk/duets/)
> which aims to collect information on where research is needed, based on
> recommendations for future research from systematic reviews and other
> research - this is often a place to go if I want to check whether there is a
> gap in the evidence on an intervention.
>
> Julie
>
> Julie Glanville
> Project Director - Information Services
>
> York Health Economics Consortium Ltd
> University of York
> Market Square
> Vanbrugh Way
> Heslington
> YORK YO10 5NH
>
> Tel: 01904 434832 (Direct) 433620 (General)
> Fax: 01904 433628
> email: [log in to unmask]
>
> website: www.yhec.co.uk
>
> This e-mail is for the use of the intended addressee only. If you receive
> this e-mail by mistake please delete it and notify the sender immediately.
>
> Privileged, confidential and/or copyright information may be contained in
> this e-mail and any attachments. You are not permitted to copy, forward, or
> disclose the information (or any part of it) contained in this message. To
> do so is prohibited.
>
> This message and any attachments have been scanned for viruses using Sophos
> antivirus software (www.sophos.com)
>
>
>
> _____
>
> From: Evidence based health (EBH)
> [mailto:[log in to unmask]] On Behalf Of Paul Elias
> Sent: 22 April 2009 04:22
> To: [log in to unmask]
> Subject: Re: FW: Systematic Reviews as Research
>
>
>
> Hi, I think that the question really lends the weight to the evidence based
> approach and that deciding where to put resources e.g. a SR or a new study
> can be made when a sufficiently exhaustive search of the evidence base is
> done. This can be done initially and quickly, cheaply, comprehensively based
> on suitable search/key word/MeSH terms etc., a suitable PICO search methods
> etc. I think this is a sensible approach and can let one see if any
> controlled clinical studies exist and this can thejn drive further testable
> hypotheses and studies. As well, a suitable and thorough initial search and
> selection of studies can show what reviews are already done, what they have
> found, or did not find, and what would be needed next. So a good, rogorous
> initial PICO/PIO etc. type search to me is the first step to flesh out
> suitable terms and then a godd broad search of the literature e.g.
> Medline/Ovid, Cochrane, EMBASE, TRIP, MEDION, PUBMED, clinicaltrials.gov
> etc...trials should be designed in light of existing knowledge. One limiting
> factor still seems to be in the discussion section of most papers, there is
> still a paucity of reference to prior SR or review evidence. The aim of
> conducting trials is to build on what was done prior and enlarge the
> evidence base. Moreover, in designing trials, one should use prior SR as
> background to shape the direction of the trial...
>
>
>
>
>
> Best,
>
> Paul
>
>
> --- On Tue, 4/21/09, Rakesh Biswas <[log in to unmask]> wrote:
>
>
>
> From: Rakesh Biswas <[log in to unmask]>
> Subject: Re: FW: Systematic Reviews as Research
> To: [log in to unmask]
> Received: Tuesday, April 21, 2009, 5:55 PM
>
>
> What would be the role of the systematic reviewer's experience in the study
> topic?
>
> For example, would a person with training in Otorhinolaryngology be the best
> person to do a review of say " Barotrauma in air travel" or would it bias
> the reviewer?
>
> Going by the previous discussions it appears that persons with practical
> training in the topic area would be able to guage the scope of the review
> and if necessary plan a new study rather than a review (without perhaps even
> having to do a scoping study? ).
>
>
> rakesh
>
>
>
> On Tue, Apr 21, 2009 at 9:38 PM, Aicken, Catherine <[log in to unmask]
> <[log in to unmask]" target="_blank">http:[log in to unmask]> >
> wrote:
>
>
> Hi,
>
> Just as you would conduct a literature review to inform the precise research
> question for a piece of primary research, you can conduct a scoping study to
> gain greater knowledge of the research area of a systematic review, before
> you define the research question and begin the review. You're then likely
> to have a better idea as to whether you'll be finding 100 studies or 2 - and
> you can adjust the research question to be addressed by the systematic
> review, appropriately.
>
> Hope that's helpful.
>
> Catherine
>
> Catherine Aicken
> Research Associate / MSTIC Study Co-ordinator
> Centre for Sexual Health & HIV Research
> Research Department of Infection & Population Health
> University College London
> Mortimer Market Centre
> off Capper Street
> London
> WC1E 6JB
>
> Email: [log in to unmask]
> <http://ca.mc1113.mail.yahoo.com/mc/compose?to=caicken@gum.ucl.ac..uk>
> Tel: 0845 1555 000 x8146
> Fax: 020 7380 9778
> www.ucl.ac.uk/sexual-health/
>
>
> -----Original Message-----
> From: Evidence based health (EBH)
>
> [mailto:[log in to unmask]
> <http://ca.mc1113.mail.yahoo.com/mc/compose?to=EVIDENCE-BASED-HEALTH@JISCMAI
> L.AC.UK> ] On Behalf Of Richard Stevens
> Sent: 21 April 2009 15:56
> To: [log in to unmask]
> <http://ca.mc1113.mail.yahoo.com/mc/compose?to=EVIDENCE-BASED-HEALTH@JISCMAI
> L.AC.UK>
> Subject: Re: Systematic Reviews as Research
>
> Hi all - I'm Richard Stevens, a statistician who recently joined the
> Centre
> for Evidence Based Medicine in Oxford.
>
> I'd like to rephrase the question this way:
>
> How can we decide, as researchers with finite resources, when to put
> our
> efforts into systematic reviews and when to put our resources into new
>
> studies?
>
> I've been giving statistics advice to a Cochrane group, and I've been
> frustrated by the very low value of nearly all the reviews I've seen so
> far.
> The reviews are done well, but they often turn up only one or two
> studies for
> each research question, so the review is still unable to provide the
> answers
> doctors need. A systematic review is a lot of work. When I see a
> systematic
> review that still can't answer the question, I wish the researchers had
> put
> their energy into setting up a new study instead.
>
> On the other hand, there are some areas where plenty of information is
> out
> there and ripe for meta-analysis, so a systematic review is much better
> value
> than setting up a whole new study.
>
> How do we, as researchers, identify the two situations, and decide how
> to
> spend our energies?
>
> Richard
>
> --
>
> -------------------------
> Richard Stevens, Ph.D..
> Department of Primary Health Care,
> University of Oxford
> +44 1865 289355
> [log in to unmask]
> <[log in to unmask]" target="_blank">http:[log in to unmask]
> uk>
> (Please note the '2' in the email address)
>
>
>>>> "Djulbegovic, Benjamin" <[log in to unmask]
> <[log in to unmask]" target="_blank">http:[log in to unmask]> >
> wrote:
>> There is very important social reason why more people should be doing
>
>> systematic reviews. There are about 10,000 key decisions to be
> tackled in
>> medicine, and we simply don't have enough people to do the required
> number of
>> SRs. Attached is a great paper by Iain Chalmers related to "The
> lethal
>> consequences of failing to make full use of all relevant evidence
> about the
>> effects of medical treatments: the importance of systematic reviews"
>>
>> So, this should be convincing why you (as well as the rest of us)
> should
>> pitch-in.
>>
>>
>>
>> Benjamin Djulbegovic, MD, PhD
>> Professor of Medicine and Oncology
>> University of South Florida & H. Lee Moffitt Cancer Center & Research
>
>> Institute
>> Co-Director of USF Clinical Translation Science Institute
>> Director of USF Center for Evidence-based Medicine and Health
> Outcomes
>> Research
>>
>>
>> Mailing Address:
>> USF Health Clinical Research
>> 12901 Bruce B. Downs Boulevard, MDC02
>> Tampa, FL 33612
>>
>> Phone # 813-396-9178
>> Fax # 813-974-5411
>>
>> e-mail: [log in to unmask]
> <[log in to unmask]" target="_blank">http:[log in to unmask]>
> <mailto:[log in to unmask]
> <[log in to unmask]" target="_blank">http:[log in to unmask]> >
>>
>>
>> ______________________
>>
>> Campus Address: MDC02
>>
>> Office Address :
>> 13101 Bruce B. Downs Boulevard,
>> CMS3057
>> Tampa, FL 33612
>>
>>
>> From: Evidence based health (EBH)
>> [mailto:[log in to unmask]
> <http://ca.mc1113.mail.yahoo.com/mc/compose?to=EVIDENCE-BASED-HEALTH@JISCMAI
> L..AC.UK> ] On Behalf Of Raval
> Amit
>> Sent: Monday, April 20, 2009 1:33 PM
>> To: [log in to unmask]
> <http://ca.mc1113.mail.yahoo.com/mc/compose?to=EVIDENCE-BASED-HEALTH@JISCMAI
> L.AC.UK>
>> Subject: Re: Systematic Reviews as Research
>>
>>
>> Hello KamleshSir,
>>
>> I am student of pharmacy practice not qulified as become systemic
> reviewer
>> of cochrane.but I can tell you it is risky research, If somebodyelse
> doing
>> same review as you any one who publish first gets all and other
> nothing but
>> frusrtationa or self satisfaction of knowing review preparation.As
> research
>> some college give Ph.D. degree if a student completes review.Cochrane
> is the
>> bigest nonfunding source of getting review published. Within cochrane
> any one
>> can secure their reiew as intellectual property by registeing
> title.sometime
>> after your protocol you can submit protocol then within year submit
> fnal
>> review and then update every 2 year for lifelong.but you need to be
> very
>> careful for securing your research.
>>
>> From the impact poin of view I can imagine just that note down sell
> of drug
>> after positive reporting of that drug in systemic review.Guideline
> suggest
>> the grade based on the results of meta analysis.The publication is
> sure to
>> get goo
> d impact general and work can be appraised.All after benifit
> to
>> patients should be prime.because mixing apple with oranges in meta
> analysis
>> give results but influence by the conflits with lot of flaws.Strong
> back
>> groun of methodology is must.You can find more information in South
> Asia
>> cochrane network (SANC) also.
>> Impact in health policy after systemic review in India has been
> admirable.
>>
>> Some non govermental or private organisation are also doing systemic
> review
>> for their client for monetary bases.Average cost of one meta analysis
>
>> approsximately 50000$ outside cochrane within cochrane 34000$. but it
> is
>> useless as you do not get good pulication if you donot have high
>> degree.no <http://degree.no/> <http://degree.no <http://degree.no/> >
> matter ho you devote to meta analysis.
>>
>>
>> On Mon, Apr 20, 2009 at 9:01 PM, Kamlesh Bhargava
>> <[log in to unmask]
> <[log in to unmask]" target="_blank">http:[log in to unmask]>
> <mailto:[log in to unmask]
> <[log in to unmask]" target="_blank">http:[log in to unmask]> >>
> wrote:
>>
>> Dear All,
>>
>> I have to make a presentation to the researchers in my college on the
> value
>> of doing systematic reviews as research and scholarly activity.
>> Would be grateful for any references, did not find much in
> Pubmed/Google,
>> except the article by Lang.
>>
>> --
>> Dr.Kamlesh Bhargava
>> Senior Consultant
>> Family Medicine & Public Health
>> S.Q.University Hospital
>>
>> Program Director
>> Family and Community Medicine Residency Program
>> Oman Medical Specialty Board
>
>
>
>
> _____
>
> Instant message from any web browser! Try the new
> <http://ca.messenger.yahoo.com/webmessengerpromo.php> Yahoo! Canada
> Messenger for the Web BETA
>