Dear Barbara,
> I wonder if you could please help us with this CUDA error when running eddy_cuda8.0 ?
>
> I am on a remote LINUX server and have to load the modules first - but it seems that the CUDA commands are not executed properly.
>
> eddy_cuda8.0 runs for about 10 seconds and then fails - other eddy commands (eddy_openmp, eddy) don't have this problem.
>
> Could you please provide a hint to what may be wrong (i.e. do I have to install FSL in a certain way so that it knows where to find CUDA etc.? It doesn't seem to be an error that googling can solve, so happy to hear your thoughts.
I am afraid that it looks like one of those errors you sometimes get with CUDA, but which can be very difficult to debug. The "important" information is
> ...................Allocated GPU # 0...................
> thrust::system_error thrown in CudaVolume::common_assignment_from_newimage_vol after resize() with message: function_attributes(): after cudaFuncGetAttributes: invalid device function
> function_attributes(): after cudaFuncGetAttributes: invalid device function
> EDDY::: cuda/CudaVolume.cu::: void EDDY::CudaVolume::common_assignment_from_newimage_vol(const NEWIMAGE::volume<float>&, bool): Exception thrown
which says that the error occurs in a routine in the thrust library (not an FSL library). Usually it means that the application (eddy) was compiled with a version of CUDA that requires a higher compute capability (means ~newer) than your hardware has. But I have seen examples of this error when that is not the case.
If you haven't got the latest version of FSL installed I suggest to start with upgrading and see if the problem persists.
Jesper
>
> Thank you,
>
> Kind wishes,
>
> Barbara
>
>
>
>
> module load cuda80/toolkit/8.0.61
>
> eddy_cuda8.0 --repol --verbose --flm=quadratic --ff=10.0 --acqp=.EPI_DTI_acqparams.txt --bvals=.EPI_DTI.bvals --bvecs=.EPI_DTI.bvecs --imain=.EPI_DTI.nii.gz --index=.EPI_DTI_index.txt --mask=.EPI_DTI_b0_topup_avg_brain_mask.nii.gz --topup=_EPI_DTI_b0_topup --interp=spline --resamp=jac --niter=5 --nvoxhp=1000 --out=.EPI_DTI_eddy --slm=none
> Reading images
> Performing volume-to-volume registration
> Running Register
>
> ...................Allocated GPU # 0...................
> thrust::system_error thrown in CudaVolume::common_assignment_from_newimage_vol after resize() with message: function_attributes(): after cudaFuncGetAttributes: invalid device function
> function_attributes(): after cudaFuncGetAttributes: invalid device function
> EDDY::: cuda/CudaVolume.cu::: void EDDY::CudaVolume::common_assignment_from_newimage_vol(const NEWIMAGE::volume<float>&, bool): Exception thrown
> EDDY::: cuda/CudaVolume.h::: EDDY::CudaVolume::CudaVolume(const NEWIMAGE::volume<float>&, bool): Exception thrown
> EDDY::: cuda/EddyInternalGpuUtils.cu::: static void EDDY::EddyInternalGpuUtils::load_prediction_maker(const EDDY::EddyCommandLineOptions&, EDDY::ScanType, const EDDY::ECScanManager&, unsigned int, float, bool, const EDDY::PolationPara&, std::shared_ptr<EDDY::DWIPredictionMaker>, NEWIMAGE::volume<float>&): Exception thrown
> EDDY::: cuda/EddyGpuUtils.cu::: static std::shared_ptr<EDDY::DWIPredictionMaker> EDDY::EddyGpuUtils::LoadPredictionMaker(const EDDY::EddyCommandLineOptions&, EDDY::ScanType, const EDDY::ECScanManager&, unsigned int, float, NEWIMAGE::volume<float>&, bool): Exception thrown
> EDDY::: eddy.cpp::: EDDY::ReplacementManager* EDDY::Register(const EDDY::EddyCommandLineOptions&, EDDY::ScanType, unsigned int, const std::vector<float, std::allocator<float> >&, EDDY::SecondLevelECModel, bool, EDDY::ECScanManager&, EDDY::ReplacementManager*, NEWMAT::Matrix&, NEWMAT::Matrix&): Exception thrown
> EDDY::: Eddy failed with message EDDY::: eddy.cpp::: EDDY::ReplacementManager* EDDY::DoVolumeToVolumeRegistration(const EDDY::EddyCommandLineOptions&, EDDY::ECScanManager&): Exception thrown
>
> ########################################################################
>
> To unsubscribe from the FSL list, click the following link:
> https://www.jiscmail.ac.uk/cgi-bin/WA-JISC.exe?SUBED1=FSL&A=1
>
> This message was issued to members of www.jiscmail.ac.uk/FSL, a mailing list hosted by www.jiscmail.ac.uk, terms & conditions are available at https://www.jiscmail.ac.uk/policyandsecurity/
########################################################################
To unsubscribe from the FSL list, click the following link:
https://www.jiscmail.ac.uk/cgi-bin/WA-JISC.exe?SUBED1=FSL&A=1
This message was issued to members of www.jiscmail.ac.uk/FSL, a mailing list hosted by www.jiscmail.ac.uk, terms & conditions are available at https://www.jiscmail.ac.uk/policyandsecurity/
|