Hi Marcus,
I think you should replace xrdcp with rfcp which doesn't require any
authentication when run by root from the head node. The only drawback is
that if by any chance you have less real space than what you have
reserved in the space tokens (typically when a data server is down) the
rfcp command will fail.
Second looking at the directories you created they only contain the dump
directory. Where are the other directories (rucio and SAM) with the
ATLAS data?
lcg-ls
srm://srm.glite.ecdf.ed.ac.uk/dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk
/dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dump
cheers
alessandra
On 10/12/2015 10:34, Marcus Ebert wrote:
> Hi Shaun,
>
> The script provided by ATLAS is copying to a local area using xrdcp.
> In this case here, the command looks like:
> xrdcp -d3 $HOME/bin/atlasscratchdisk-dump_20151207
> root://srm.glite.ecdf.ed.ac.uk//dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps/dump_20151207
>
> which is executed on srm.glite.ecdf.ed.ac.uk.
> Just before the xrdcp command, the 2 following commands are in the
> script which work:
> dpns-mkdir -p /dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps
> dpns-setacl -m g:atlas:rwx,m:rwx
> /dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps
>
> Switching on debug information, I get:
> [2015-12-10 10:06:37.667988 +0000][Debug ][Utility ]
> Creating a classic copy job, from
> file://atlasscratchdisk-dump_20151207 to
> root://srm.glite.ecdf.ed.ac.uk:1094//dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps/dump_20151207
> [2015-12-10 10:06:37.668048 +0000][Debug ][Utility ]
> Opening atlasscratchdisk-dump_20151207 for reading
> [2015-12-10 10:06:37.668092 +0000][Debug ][Utility ]
> Opening
> root://srm.glite.ecdf.ed.ac.uk:1094//dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps/dump_20151207?oss.asize=101029841
> for writing
> [2015-12-10 10:06:37.668133 +0000][Dump ][Utility ] URL:
> root://srm.glite.ecdf.ed.ac.uk:1094//dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps/dump_20151207?oss.asize=101029841
> [2015-12-10 10:06:37.668133 +0000][Dump ][Utility ]
> Protocol: root
> [2015-12-10 10:06:37.668133 +0000][Dump ][Utility ] User
> Name:
> [2015-12-10 10:06:37.668133 +0000][Dump ][Utility ] Password:
> [2015-12-10 10:06:37.668133 +0000][Dump ][Utility ] Host
> Name:srm.glite.ecdf.ed.ac.uk
> [2015-12-10 10:06:37.668133 +0000][Dump ][Utility ]
> Port: 1094
> [2015-12-10 10:06:37.668133 +0000][Dump ][Utility ] Path:
> /dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps/dump_20151207
> [2015-12-10 10:06:37.668187 +0000][Dump ][Utility ] URL:
> root://srm.glite.ecdf.ed.ac.uk:1094//dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps/dump_20151207?oss.asize=101029841
> [2015-12-10 10:06:37.668187 +0000][Dump ][Utility ]
> Protocol: root
> [2015-12-10 10:06:37.668187 +0000][Dump ][Utility ] User
> Name:
> [2015-12-10 10:06:37.668187 +0000][Dump ][Utility ] Password:
> [2015-12-10 10:06:37.668187 +0000][Dump ][Utility ] Host
> Name:srm.glite.ecdf.ed.ac.uk
> [2015-12-10 10:06:37.668187 +0000][Dump ][Utility ]
> Port: 1094
> [2015-12-10 10:06:37.668187 +0000][Dump ][Utility ] Path:
> /dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps/dump_20151207
> [2015-12-10 10:06:37.668218 +0000][Debug ][File ]
> [0x1346b170@root://srm.glite.ecdf.ed.ac.uk:1094//dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps/dump_20151207?oss.asize=101029841]
> Sending an open command
> [2015-12-10 10:06:37.668247 +0000][Dump ][XRootD ]
> [srm.glite.ecdf.ed.ac.uk:1094] Sending message kXR_open (file:
> /dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps/dump_20151207?oss.asize=101029841,
> mode: 0644, flags: kXR_new kXR_open_updt kXR_async kXR_retstat )
> [2015-12-10 10:06:37.668275 +0000][Dump ][PostMaster ]
> [srm.glite.ecdf.ed.ac.uk:1094 #0] Sending message kXR_open (file:
> /dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps/dump_20151207?oss.asize=101029841,
> mode: 0644, flags: kXR_new kXR_open_updt kXR_async kXR_retstat )
> (0x135e40a0) through substream 0 expecting answer at 0
> [2015-12-10 10:06:37.668336 +0000][Dump ][AsyncSock ]
> [srm.glite.ecdf.ed.ac.uk:1094 #0.0] Wrote a message: kXR_open (file:
> /dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps/dump_20151207?oss.asize=101029841,
> mode: 0644, flags: kXR_new kXR_open_updt kXR_async kXR_retstat )
> (0x135e40a0), 116 bytes
> [2015-12-10 10:06:37.668364 +0000][Dump ][AsyncSock ]
> [srm.glite.ecdf.ed.ac.uk:1094 #0.0] Successfully sent message:
> kXR_open (file:
> /dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps/dump_20151207?oss.asize=101029841,
> mode: 0644, flags: kXR_new kXR_open_updt kXR_async kXR_retstat )
> (0x135e40a0).
> [2015-12-10 10:06:37.668381 +0000][Dump ][XRootD ]
> [srm.glite.ecdf.ed.ac.uk:1094] Message kXR_open (file:
> /dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps/dump_20151207?oss.asize=101029841,
> mode: 0644, flags: kXR_new kXR_open_updt kXR_async kXR_retstat ) has
> been successfully sent.
> [2015-12-10 10:06:37.668407 +0000][Dump ][PostMaster ]
> [srm.glite.ecdf.ed.ac.uk:1094 #0.0] Nothing to write, disable uplink
> [2015-12-10 10:06:37.682412 +0000][Dump ][XRootDTransport ] [msg:
> 0x135e3f40] Expecting 22 bytes of message body
> [2015-12-10 10:06:37.682451 +0000][Dump ][AsyncSock ]
> [srm.glite.ecdf.ed.ac.uk:1094 #0.0] Received message header for
> 0x135e3f40 size: 8
> [2015-12-10 10:06:37.682477 +0000][Dump ][AsyncSock ]
> [srm.glite.ecdf.ed.ac.uk:1094 #0.0] Received message 0x135e3f40 of 30
> bytes
> [2015-12-10 10:06:37.682494 +0000][Dump ][PostMaster ]
> [srm.glite.ecdf.ed.ac.uk:1094 #0] Handling received message: 0x135e3f40.
> [2015-12-10 10:06:37.682532 +0000][Dump ][XRootD ]
> [srm.glite.ecdf.ed.ac.uk:1094] Got a kXR_error response to request
> kXR_open (file:
> /dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps/dump_20151207?oss.asize=101029841,
> mode: 0644, flags: kXR_new kXR_open_updt kXR_async kXR_retstat )
> [3010] Permission denied
> [2015-12-10 10:06:37.682566 +0000][Debug ][XRootD ]
> [srm.glite.ecdf.ed.ac.uk:1094] Handling error while processing
> kXR_open (file:
> /dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps/dump_20151207?oss.asize=101029841,
> mode: 0644, flags: kXR_new kXR_open_updt kXR_async kXR_retstat ):
> [ERROR] Error response: Unknown error 3010.
> [2015-12-10 10:06:37.682615 +0000][Debug ][File ]
> [0x1346b170@root://srm.glite.ecdf.ed.ac.uk:1094//dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps/dump_20151207?oss.asize=101029841]
> Open has returned with status [ERROR] Server responded with an error:
> [3010] Permission denied
> [2015-12-10 10:06:37.682640 +0000][Debug ][File ]
> [0x1346b170@root://srm.glite.ecdf.ed.ac.uk:1094//dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps/dump_20151207?oss.asize=101029841]
> Error while opening at srm.glite.ecdf.ed.ac.uk:1094: [ERROR] Server
> responded with an error: [3010] Permission denied
>
> It looks like that the directory created by dpns-mkdir is different
> than what xrootd is trying to write to. The copy tries to put the file
> in
> root://srm.glite.ecdf.ed.ac.uk:1094//dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps
> but that doesn't exists while the one created with dpns-mkdir is still
> there:
> [root@srm bin]# xrd srm.glite.ecdf.ed.ac.uk ls
> /dpm/glite.ecdf.ed.ac.uk/home/atlas/atlasscratchdisk/dumps
>
> [root@srm bin]#
>
> (just empty, doesn't exist)
> [root@srm bin]# xrd srm.glite.ecdf.ed.ac.uk ls /
> dr-x(019) 0 2015-07-21 13:36:23 /atlas
> dr-x(019) 0 2012-01-05 22:12:09 /cms
> dr-x(019) 0 2014-11-20 11:46:19 /dteam
> dr-x(019) 0 2008-08-01 03:42:24 /gridpp
> dr-x(019) 0 2010-05-21 08:24:53 /hone
> dr-x(019) 0 2011-03-02 20:10:51 /ilc
> dr-x(019) 0 2011-07-11 17:55:57 /ildg
> dr-x(019) 0 2011-01-11 11:09:14 /lhcb
> dr-x(019) 0 2015-12-10 10:26:37 /ops
> dr-x(019) 0 2008-07-01 03:42:24 /vo.gridpp.ac.uk
> dr-x(019) 0 2008-11-01 04:42:32 /vo.nanocmos.ac.uk
> dr-x(019) 0 2008-05-01 03:42:22 /vo.scotgrid.ac.uk
>
> [root@srm bin]# xrd srm.glite.ecdf.ed.ac.uk ls
> /atlas/atlasscratchdisk/dumps
>
> [root@srm bin]# xrd srm.glite.ecdf.ed.ac.uk ls /atlas/atlasscratchdisk/
> dr-x(019) 0 2015-12-10 10:25:24 /atlas/atlasscratchdisk/SAM
> dr-x(019) 0 2015-11-09 17:56:40 /atlas/atlasscratchdisk/rucio
> dr-x(019) 0 2011-09-06 21:04:18
> /atlas/atlasscratchdisk/user.elenao
> dr-x(019) 0 2011-05-09 03:30:46
> /atlas/atlasscratchdisk/user.mpedraza
> dr-x(019) 0 2010-09-12 10:38:40
> /atlas/atlasscratchdisk/user.picazio
> -r--(016) 5 2015-11-18 22:44:15
> /atlas/atlasscratchdisk/wahtest
>
> Not sure if there is anything special on our site that this is
> different and doesn't work. But would be good to see how the above
> looks on other sites.
>
> Cheers,
> Marcus
>
> On Thu, 10 Dec 2015, [log in to unmask] wrote:
>
>> Hi Marcus
>>
>> Not knowing a bit more it's difficult to say. I don't know where you
>> are copying from and to. The problem may be at the destination site.
>> Assuming you are the source site...
>> 1. Try copying the file to some local disk. If you still get the
>> permission denied, the problem is on you side; if not you will need
>> to contact the destination site
>> 2. Assuming the problem is at your side (which I doubt) try running
>> xrdcp -d 3 .... which will produce reams and reams of output some of
>> which may be useful
>>
>> Shaun
>>
>> -----Original Message-----
>> From: GRIDPP2: Deployment and support of SRM and local storage
>> management [mailto:[log in to unmask]] On Behalf Of Marcus
>> Ebert
>> Sent: 09 December 2015 10:10
>> To: [log in to unmask]
>> Subject: problem with Atlas dump
>>
>> Hi all,
>>
>> maybe this is the best place to ask for it, let me know if not:
>> When creating the Atlas dumps, everything works except the final
>> xrdcp which results in (was from Monday):
>> Creating proxy ......................... Done
>>
>> Your proxy is valid until Tue Dec 8 21:35:04 2015
>> [0B/0B][100%][==================================================][0B/s]
>> Run: [ERROR] Server responded with an error: [3010] Permission denied
>>
>> [0B/0B][100%][==================================================][0B/s]
>> Run: [ERROR] Server responded with an error: [3010] Permission denied
>>
>> [0B/0B][100%][==================================================][0B/s]
>> Run: [ERROR] Server responded with an error: [3010] Permission denied
>>
>> The mapping to Atlas was done as it is mentioned at the beginning of
>> the provided script, and also the creating of the directory and
>> changing acl just before the xrdcp worked, only the xrdcp fails.
>>
>> Has anyone else seen this on another site or knows the reason for it?
>>
>> Cheers,
>> Marcus
>>
>> --
>> The University of Edinburgh is a charitable body, registered in
>> Scotland, with registration number SC005336.
>>
>
--
Respect is a rational process. \\//
Fatti non foste a viver come bruti (Dante)
|