I have transfered in less than 2 hours 244 of 1025 files. Not bad!

How can I change the number of concurrent streams. I have looked but not yet 
found any indication.

Lydia


On Mon, 22 Jun 2015, Jensen, Jens (STFC,RAL,SC) wrote:

> So the green stuff in the plot below ought to be DiRAC:
>
> [Storage_CASTOR_Gen]
> <http://ganglia.gridpp.rl.ac.uk/ganglia/graph_all_periods.php?c=Storage_CASTOR_Gen&m=network_report&r=4hr&s=by%20name&hc=4&mc=2&st=1434980146&g=network_report&z=large>
>
> 250 MB/s is about 2.5 Gb/s so we ought to be able to go a bit higher.
>
> Another thing to check is how many parallel streams are used in the
> GridFTP transfers. We ought to be able to speed it up a bit using the
> magic number of streams. Luckily Brian is our resident expert in
> gridftpparallelstreamological tuning :-)
>
> Cheers
> -j
>
>
> On 22/06/2015 13:57, Brian Davies wrote:
>> This link shows ganglia rates for disk servers at RAL
>> http://ganglia.gridpp.rl.ac.uk/ganglia/?r=hour&cs=&ce=&c=Storage_CASTOR_Gen&h=&tab=m&vn=&hide-hf=false&m=network_report&sh=1&z=small&hc=4&host_regex=gdss6%2818|19|20|21|22|23|24%29&max_graphs=0&s=by+name
>> Trying to see when the jobs get into the FTS monitoring system.
>> Brian
>>
>> -----Original Message-----
>> From: DiRAC Users [mailto:[log in to unmask]] On Behalf Of Lydia Heck
>> Sent: 22 June 2015 13:42
>> To: [log in to unmask]
>> Subject: Re: I-it lives!
>>
>> I get peak 250 MByte/sec ....
>>
>> Lydia
>>
>>
>> On Mon, 22 Jun 2015, Dr Jens Jensen wrote:
>>
>>> Yes, they may have been transfers that have started.
>>>
>>> At 4 gigs per file, let's see if we can do 1000 files before your proxy turns into a pumpkin.
>>>
>>> Cheers
>>> --jens
>>>
>>>
>>> -----Original Message-----
>>> From: Lydia Heck [mailto:[log in to unmask]]
>>> Sent: 22 June 2015 13:34
>>> To: Jensen, Jens (STFC,RAL,SC)
>>> Cc: [log in to unmask]
>>> Subject: Re: I-it lives!
>>>
>>>
>>> They will fill up, I assume. I am seening that 20 have finished so
>>> far!!! which is pretty good going, as I have taken default parameters until now.
>>>
>>> Not bad for a morning's work :-)
>>>
>>> Lydia
>>>
>>>
>>> On Mon, 22 Jun 2015, Jensen, Jens (STFC,RAL,SC) wrote:
>>>
>>>> On 22/06/2015 13:19, Lydia Heck wrote:
>>>>> 22 of the submitted files failed. - actually all that went through ....
>>>>>
>>>> I see 18 files; some are zero lentgh though
>>>>
>>>> -rw-r--r--   1 dirac01  diracvo          4130989504 Jun 22 13:04 L800_272.1
>>>> -rw-r--r--   1 dirac01  diracvo                   0 Jun 22 13:27
>>>> L800_272.112
>>>> -rw-r--r--   1 dirac01  diracvo                   0 Jun 22 13:27
>>>> L800_272.119
>>>> -rw-r--r--   1 dirac01  diracvo          4118473792 Jun 22 13:26
>>>> L800_272.128
>>>> -rw-r--r--   1 dirac01  diracvo                   0 Jun 22 13:27
>>>> L800_272.149
>>>> -rw-r--r--   1 dirac01  diracvo                   0 Jun 22 13:27
>>>> L800_272.151
>>>> -rw-r--r--   1 dirac01  diracvo                   0 Jun 22 13:27
>>>> L800_272.164
>>>> -rw-r--r--   1 dirac01  diracvo          4014241760 Jun 22 13:26
>>>> L800_272.196
>>>> -rw-r--r--   1 dirac01  diracvo                   0 Jun 22 13:27
>>>> L800_272.216
>>>> -rw-r--r--   1 dirac01  diracvo          3761582368 Jun 22 13:25
>>>> L800_272.224
>>>> -rw-r--r--   1 dirac01  diracvo          4078336384 Jun 22 13:26 L800_272.39
>>>> -rw-r--r--   1 dirac01  diracvo          4257454048 Jun 22 13:26 L800_272.45
>>>> -rw-r--r--   1 dirac01  diracvo          4015119840 Jun 22 13:28
>>>> L800_272.792
>>>> -rw-r--r--   1 dirac01  diracvo          4135726336 Jun 22 13:26
>>>> L800_272.894
>>>> -rw-r--r--   1 dirac01  diracvo          4135450560 Jun 22 13:26 L800_272.92
>>>> -rw-r--r--   1 dirac01  diracvo          3820429728 Jun 22 13:26
>>>> L800_272.922
>>>> -rw-r--r--   1 dirac01  diracvo          3999941856 Jun 22 13:26
>>>> L800_272.938
>>>> -rw-r--r--   1 dirac01  diracvo          3940193824 Jun 22 13:26
>>>> L800_272.948
>>>>
>
>