On 20/09/12 15:23, Wahid Bhimji wrote:
> Doh - yes I am being stupid today...
>
> OK - so indeed that also doesn't work - with the error you anticipated
> [oldjock] ~> lcg-cp -b file:/phys/linux/wbhimji/bob gsiftp://se03.esc.qmul.ac.uk/mnt/lustre_0/storm_3/atlas/atlasscratchdisk/wahidsfile
> file:/phys/linux/wbhimji/bob: globus_ftp_client: the server responded with an error
> 500 Command failed. : open/create error: Permission denied
>
> Once the file is created though (for example via srm) the I can overwrite it with
>
> [oldjock] ~> lcg-cp -v file:/phys/linux/wbhimji/bill gsiftp://se03.esc.qmul.ac.uk:2811//mnt/lustre_0/storm_3/atlas/atlasscratchdisk/wahidsfile
> Using grid catalog type: UNKNOWN
> Using grid catalog : prod-lfc-atlas.cern.ch
> VO name: atlas
> Checksum type: None
> Source URL: file:/phys/linux/wbhimji/bill
> File size: 6
> Source URL for copy: file:/phys/linux/wbhimji/bill
> Destination URL: gsiftp://se03.esc.qmul.ac.uk:2811//mnt/lustre_0/storm_3/atlas/atlasscratchdisk/wahidsfile
> # streams: 1
> 6 bytes 0.02 KB/sec avg 0.02 KB/sec inst
> Transfer took 1030 ms
>
>
Yes.
Do we think that's a bug? I _think_ I do.
I think this is best discussed on the storage list. I've copied it in
and set "reply-to" to there.
Chris
> wahid
>
> On 20 Sep 2012, at 15:13, Christopher J. Walker wrote:
>
>> On 20/09/12 14:54, Wahid Bhimji wrote:
>>> Are you sure it won't work .
>>>
>>> I am fairly sure that I copied files into a storm node before using gridftp and it had the right ownership
>>>
>>> Mind you my test didn't work
>>>
>>> [oldjock] ~> lcg-cp -b file:/phys/linux/wbhimji/bob gsiftp://se03.esc.qmul.ac.uk/dpm/ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/wahidsfile
>>> lcg-cp: globus_list.c:90: globus_list_rest: Assertion `head != 0' failed.
>>> Aborted
>>>
>>> wheras that does work on DPM
>>> (is se03 actually your gridftp server ?)
>>
>> Yes (or se04 at present).
>>
>> What you've done won't work anyway - path would be gridftp://se03.esc.qmul.ac.uk/mnt/lustre_0/storm_3/atlas/atlasscratchdisk/wahidsfile
>>
>> Do feel fry to try though.
>>
>>
>> Chris
>>>
>>> Wahid
>>>
>>> On 20 Sep 2012, at 14:41, Christopher J. Walker wrote:
>>>
>>>> On 20/09/12 14:17, Wahid Bhimji wrote:
>>>>> Hi Brian
>>>>>
>>>>> Something just struck me wrt. transfer rates in UK. Would it be worth trying gridftp only transfers in FTS in UK - to see if removing SRM overheads helps things.
>>>>> That should be possible (used for EOS on ATLAS for example).
>>>>> Maybe you already tried it (or there is some problem I am not thinking off).
>>>>>
>>>>> Might not work with DPM - because of the spacetoken... but should work with QM where namespace and ST are same.
>>>>
>>>> Won't work with QM.
>>>>
>>>> StoRM owns the directories and touches the file then adds posix acls to allow other users to write to it.
>>>>
>>>>
>>>> I did however discuss this with Brian - and he pointed out that RAL transfers only use one TCP stream - Tier-1 transfers use more (10 IIRC). They are therefore less hit by packet loss.
>>>>
>>>> Brian's belief is that multiple TCP streams result in reads and writes to multiple parts of the file - and therefore more load on the disk servers. Can we confirm this?
>>>>
>>>> We should also investigate if there is packet loss on the path between sites.
>>>>
>>>> Chris
>>>>
>>>
>>>
>>
>>
>
>
|