Dear Xingbao,
I do not think that you did anything incorrect in your
analyses. Results from Bayesian model selection can differ between SPM5
and SPM8 because they use different approximations for the log evidence.
BMS in SPM5 is based on AIC/BIC whereas in SPM8, BMS uses the negative free
energy (F). The critical difference between these approximations is how
they define the complexity of a model. For example, AIC/BIC only take into
account the number of model parameters, regardless of the degree of
interdependence amongst these parameters. In contrast, F does consider
such interdependencies (and has some other properties), which, in most
instances, renders it a more appropriate measure of the complexity of a
model. For this reason, all model comparisons in SPM8, whether for DCM or
other applications, now use F. (For a full discussion of the relative
advantages of F and AIC/BIC see our recent random effects BMS
paper).
Because of these differences in defining complexity, BMS results
can differ when using SPM8 versus SPM5. This is not necessarily the case
(for my interhemispheric model, for example, the model rankings are identical
for F and AIC/BIC), but it is possible. As long as you clearly describe
which approximation you have used, you can use either F or AIC/BIC; the informed
reader will then know what assumptions your BMS procedure is based on. And
concerning your final question: yes, of course, you can still cite the older DCM
papers that used AIC/BIC.
All the best,
Klaas
Von: "Li MD, Xingbao"
<[log in to unmask]>
An:
"[log in to unmask]" <[log in to unmask]>
Gesendet: Dienstag, den 16. Juni 2009,
21:20:04 Uhr
Betreff: DCM model
selection
Dear Dr. Stephan,
You wrote an email on Feb 16,
2009 regarding the Bayesian model selection tool in SPM8. " All model
comparisons now use the negative free energy (F) as an approximation to the log
evidence; the use of AIC/BIC has been abandoned. The results of the model
comparison are described in a "BMS.mat" file that is written to disk." Do you
mean that SPM5 is not available to do BMS? Can I still cite these paper from
SPM5 (Stephan 2007, J of Neuroscience).
One data set with 3 models was run
with SPM 5 (compare Model) and SPM8 (Batch) respectively. The results puzzled
me. Could you please help me to understand the results? Why they are
different? If I am wrong, can you advise where I did incorrectly. (see attached
results)
Best regards,
Xingbao Li, MD
Assistant
Professor
Brain Stimulation Laboratory
Institute of Psychiatry
Medical
University of South Carolina
67 President Street, room 504 North
PO Box
250861
Charleston, SC 29425 USA
Phone: 1 (843) 792 5729
Fax: 1 (843)
792 5702
email:
[log in to unmask]www.musc.edu/fnrd/tms.htm