Hi,
I have been given access to Durham's Cluster at a reasonable price per cpu per hour.
While it is reasonable, I still would like us to spend as little money as possible while keeping a good processing speed when using relion. I was thus thinking of using more memory and less cores.
I have tried to play on my local machine with the J value and the number of MPI. I do see a similar processing time with 10MPI/J1 and 4 MPI/J4, and even up to 10 MPI/J8 is faster then 10 MPI/J1.
I know the Durham's cluster has hyperthreading turned on and lots of memory available that relion is not really using. Do you think it would make sense to increase the J value to reduce the cost of usage or will our runs will just be longer and thus the gain wouldn't be worth?
I have been asked if the code was scaling very well or not ... I suspect it is and that is why using J is not recommended. Is that correct?
Have you done any benchmarking on your own cluster?
Any comments would be much appreciated.
Thanks,
Ludo