I fear that with some of the latest comments in this thread that Mike Stuart
and I run the risk of being misunderstood. I want to avoid us being
mischaracterized and clarify some points about the VTE guideline, so I provide
a little more information about us here. I also want to address some important
points raised in this thread. However, my full response is very long, so in the
interest of keeping this spare, I present some information and suggestions here
and have created a link on our webpage with a fuller response.
About the KPHI VTE Guideline and About Delfini
- The guideline is not an industry-funded guideline. It is the Kaiser Permanente
Hawaii VTE Guideline. We trained them, facilitated the process and did much
work on the guideline. We were provided some funding by them which covered
some of the training, and we donated much time.
- The guideline was not made available as a free sample. (We do not sell
clinical guidelines.) We are public-service oriented, are personally trying to
improve a huge problem in health care. We make almost all of our work
available for free on our website in an effort to help improve healthcare.
- Transparency is vital. We make it clear on the website that guideline
supporting documents are available upon request to me at [log in to unmask]
(The files are huge and not easy for me to put up on the website, but I will
happily email specific items upon request.)
- Mike and I are two individuals with a lot of EBM expertise who make a living
providing evidence-based quality improvement services. If we have a bias it is
toward the patient and toward science.
- We are not “playing in EBM space” — Mike, in particular, has incredibly deep
experience putting evidence-based medicine into practice. We explain more at
the longer response.
We announced the information about the guideline as a service to provide
another option to health care providers and patients. I, for one, know that I
would feel more comfortable having a compression device along with drug
therapy. Even though the evidence for compression is weak, weak evidence
does not mean something doesn’t work, it makes sense and harms appear to be
low. I believe I would be better protected. This is a recommendation I would
make to my mother. That is how I view all my work.
Addressing Ben’s last comments and Peter’s Question:
David is right. It is all about critical appraisal. Ben states, “It does not bode
well on EBM if the ACCP guidelines are not considered credible and useful. For
this is ‘as good as it gets’…” I would never accept a statement like this to rely
upon a guideline. Medical science-based content should be scrutinized
especially given the wide variation in critical appraisal skills and frequent need
for judgments to be made (not to mention other possible factors such as group
process, politics, influence, bias, etc.) which I state generally and not specific
to ACCP. Rather I do what Mike and I did. We do a critical appraisal audit
(and after seeing so many problems in quality, more frequently as of late we
favor critically appraising all the included studies if we agree with the search
methods and exclusions).
Regarding Peter’s Question: “How do we factor in the purely human tendency
to accept / value more a product for which we have paid than one which we
have "free" access?” We don’t think one should. We think that it is important
to have skills in critical appraisal, to look at the processes used, to audit the
information used, etc., to evaluate the work of any and all regardless of their
affiliation and relationships, etc.
At this point in time, we should all be very cautious about relying on any group
on the basis of reputation. Important problems can be found in even the most
respected sources such as Cochrane and others. We’ve seen this frequently in
our work. Lundh and Gotzsche found great variation in the quality of the work
of the 50 Cochrane groups in terms of assessing bias in studies. [Lundh A,
Gotzsche PC. Recommendations by Cochrane Review Groups for assessment of
the risk of bias in studies. BMC Med Res Methodol. 2008 Apr 21;8(1):22 [Epub
ahead of print]. PMID: 18426565.]
Considering objectivity is important, but in doing so it is also important to
realize that everyone and every group has some kind of bias. The biggest
problem we see is an overall lack of skill in critical appraisal concepts,
processes and critical thinking. The biggest need we see is a change in this
area which we think is key to solving many problems in health care. Critical
appraisal should be applied to every piece of health care information you
encounter.
Again, David is right. I write more about the problems Mike and I see and what
I believe to be important solutions at this link:
http://www.delfini.org/delfini_EBM_ListservResponse.htm.
Sheri Strite
[log in to unmask]
|