i also posted to the list recently, asking about using either MDCE or
the sun grid engine to do this, but got no replies.
i think there is a good deal of advantage to be had in being able to
do this sort of work with a job manager (either the MDCE or the more
highly customizable SGE) but i am unclear as to how to get SPM to
submit jobs to these job managers - i am a sysadmin, not a matlab
programmer.
someone posted to this list last year, talking about using the SGE to
manage SPM jobs on a cluster, but the discussion didn't go very far.
i know that the latest version of FSL has the ability to submit jobs
to the SGE built in, are there any plans to develop a similar ability
for SPM?
On Aug 24, 2007, at 8:56 AM, Alle Meije Wink wrote:
> Alexa/Matthew/others
>
> Apparently the format in which the analysis job files are stored is
> XML,
> so it might also be an idea to have an XML-engine type program
> write out
> the analysis job file, and then call SPM with that file from
> outside matlab?
>
> generateJob job1.xml <other parameters>
> ssh server1 matlab < startjob1.m
> generateJob job2.xml <other parameters>
> ssh server1 matlab < startjob2.m
>
> The degree to which you can parallellise this is of course related to
> the # of matlab licenses you have ^_^
>
> No idea how the speed-ups of different approaches compare, is there
> any
> data on that? You are probably not going to be popular running many
> matlab sessions at once, even idle sessions take up loads of mem/cpu!
>
> bw
> Alle Meije
>
> Matthew Brett wrote:
>>> I wonder if anyone out there has any experience with the new Matlab
>>> distributed computing engine and how it might work with imaging
>>> analyses? Is
>>> it helpful over the home-made alternatives such as bash scripting
>>> matlab
>>> jobs? Some colleagues are thinking of purchasing it so any
>>> thoughts would be
>>> welcome.
>>
>> I've never used the distributed computing engine, but bash / python
>> scripts work pretty well. Here's a crude first attempt I used a long
>> time ago:
>>
>> http://phiwave.sourceforge.net/howto_parallel/
>>
>> Given the advantages of python for this kind of job (free, good OO
>> model, well-developed parallel stuff, ability to call matlab), that's
>> the way I'm planning to go. I would be happy to hear from anyone
>> interested as a spur to get writing.
|