 |
 |
Hi Anderson, Thanks a lot -- that would be great! No rush at all, and I appreciate you taking the time to add it as a feature for PALM. Best wishes, David > On Jul 7, 2016, at 2:57 AM, Anderson M. Winkler <[log in to unmask]> wrote: > > Hi David, > > Not that I'm aware of. If it's something you really need, it can be added to PALM quite straightforwardly, such that instead of testing if the null is zero, one would test if it's smaller than a certain predefined threshold. If it's something that can be really useful for your analysis, let me know and it can be added (please give me a few weeks, won't have a chance of looking into it now). > > All the best, > > Anderson > > > On 6 July 2016 at 15:38, David V. Smith <[log in to unmask] <mailto:[log in to unmask]>> wrote: > Hi Anderson, > > Thanks for the feedback. All of those points make sense. I was thinking about this in the context of the non-ironic appendices of Friston's 2012 Neuroimage commentary. If we go with that and assume that d = 0.125 is "trivial", would there be a straightforward way to conduct a protected inference with any of the FSL tools (e.g., randomise, flameo, palm)? > > Cheers, > David > > >> On Jul 3, 2016, at 4:26 AM, Anderson M. Winkler <[log in to unmask] <mailto:[log in to unmask]>> wrote: >> >> Hi David, >> >> Here are some thoughts: >> >> - A half-sample doesn't have half-power. How much power is lost depends on the effect size and on the size of the full sample. >> - A conjunction of two half-samples is less powerful than the full sample. >> - Two half-samples aren't completely independent if the strategy used to recruit subjects was the same for both halves and subjects come from the same population. >> - Meta-analyses generally have a joint null hypothesis that an aggregate effect across the separate (partial) tests is zero. This isn't the same as searching for replication across samples -- the latter is a conjunction. >> - There are multiple ways in which a sample could be divided. Which to take? Repeating many times and averaging would seem an option, but that also corresponds to a type of meta-analyis. >> >> My suggestion is to use the full sample. Trivial effects are indeed a concern, and to get around it one must know what a trivial effect would be, which implies knowing something about the effect size, or about the relevance of that effect. The p-value is only one piece of a larger puzzle. >> >> Cheers, >> >> Anderson >> >> >> On 28 June 2016 at 14:34, David V. Smith <[log in to unmask] <mailto:[log in to unmask]>> wrote: >> Hello, >> >> I have a stats/fMRI question that isn't specific to FSL. Let's say I'm unsure about the population effect size for the contrast I'm examining, but I want to avoid reporting effects that are trivially small. If I download 200 subjects worth of data, would it be better to a) focus on results derived from the full sample of 200 subjects; or b) split the sample of 200 into two or more groups and focus on results that replicate across subsamples? Or, is there another approach to consider here? >> >> Thanks! >> David >> > >