Hi Chris,
you're right, it was our code issuing multiple calls from a loop.
Ironically, it was caused by adding the -v option to lcg-cr, which
actually leads the verbose output to stderr (not the best solution if
you ask me) even when the transfer was successful, and a non-zero
stderr triggers an iteration of the command since it's interpreted as
failed...
Now writing to se03 works, many thanks.
About the wms and top-dbii issue that was the beginning of this
thread: still about 30% of my jobs get cancelled at the wms's (wms02
at IC and lcgwms03 at RAL). Does anyone have any news on this issue?
Cheers,
Gustav
2011/1/26 Christopher J.Walker <[log in to unmask]>:
> Gustav Wikström wrote:
>> Hi Chris,
>>
>> I've managed to do lcg-cr to se03 with a test file, but in my jobs it
>> still fails. I added some printouts:
>>
>> Directly before trying lcg-cr the srm directory contains:
>>
>> lcg-ls srm://se03.esc.qmul.ac.uk//t2k.org/nd280/v8r5p11/cata/ND280/ND280/0000500
>> 0_00005999//:
>>
>> /t2k.org/nd280/v8r5p11/cata/ND280/ND280/00005000_00005999/oa_nd_spl_00005002-000
>> 0_nplo5.tar.gz
>>
>> /t2k.org/nd280/v8r5p11/cata/ND280/ND280/00005000_00005999/oa_nd_spl_00005004-000
>> 0_nl56b.tar.gz
>>
>> The lfn directory contains:
>>
>> lcg-ls lfn:/grid/t2k.org/nd280/v8r5p11/cata/ND280/ND280/00005000_00005999/:
>>
>> oa_nd_spl_00005002-0000_nplo5.tar.gz
>>
>> oa_nd_spl_00005004-0000_nl56b.tar.gz
>>
>>
>>
>> But still I get:
>>
>> lcg-cr -v -d srm://se03.esc.qmul.ac.uk//t2k.org/nd280/v8r5p11/cata/ND280/ND280/00005000_00005999//oa_nd_spl_00005002-0001_u3am4.tar.gz
>> -l lfn:/grid/t2k.org/nd280/v8r5p11/cata/ND280/ND280/00005000_00005999/oa_nd_spl_00005002-0001_u3am4.tar.gz
>> oa_nd_spl_00005002-0001_u3am4.tar.gz:
>>
>> Using grid catalog type: lfc
>>
>> Using grid catalog : lfc.gridpp.rl.ac.uk
>>
>> Checksum type: None
>>
>> SE type: SRMv2
>>
>> Destination SURL :
>> srm://se03.esc.qmul.ac.uk//t2k.org/nd280/v8r5p11/cata/ND280/ND280/00005000_00005999//oa_nd_spl_00005002-0001_u3am4.tar.gz
>>
>> Source SRM Request Token: b6bf3150-70bd-453c-98ab-a2d870a3f655
>>
>> srm://se03.esc.qmul.ac.uk//t2k.org/nd280/v8r5p11/cata/ND280/ND280/00005000_00005999//oa_nd_spl_00005002-0001_u3am4.tar.gz:
>> File exists
>>
>> lcg_cr: File exists
>>
>>
>>
>> The error crashes the job, but afterwards the file is there on srm. It
>> just doesn't make any sense to me.
>>
>
> I've attached the log entries.
>
> From these, it looks like you are trying to copy the file three times.
> The first one works and the second two fail because the file exists.
>
> I suspect the bug is in your script.
>
> Chris
>
>> Cheers,
>> Gustav
>>
>>
>> 2011/1/26 Stephen Burke <[log in to unmask]>:
>>> Testbed Support for GridPP member institutes [mailto:TB-
>>>> [log in to unmask]] On Behalf Of Christopher J. Walker said:
>>>> So you've filled your space allocation.
>>> Interesting - I had looked at the published space in the info system and
>>> got
>>>
>>> GlueSAStateAvailableSpace: 71829456424
>>>
>>> (from yesterday so before you increased it). Not very accurate if it was
>>> actually full!
>>>
>>> Stephen
>>>
>
>
> [root@se03 log]# grep oa_nd_spl_00005002-0001_u3am4.tar.gz storm-backend.log
> 12:55:55.744 - INFO [pool-3-thread-4] - Handling PtP chunk for user DN: /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=lwikstro/CN=627993/CN=Gustav Wikstrom; for SURL: srm://se03.esc.qmul.ac.uk:8444/t2k.org/nd280/v8r5p11/cata/ND280/ND280/00005000_00005999/oa_nd_spl_00005002-0001_u3am4.tar.gz; for requestToken: 710367dd-bb59-4f83-9c85-1aed5f4daead
> 12:55:55.798 - INFO [pool-3-thread-4] - Finished handling PtP chunk for user DN: /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=lwikstro/CN=627993/CN=Gustav Wikstrom; for SURL: srm://se03.esc.qmul.ac.uk:8444/t2k.org/nd280/v8r5p11/cata/ND280/ND280/00005000_00005999/oa_nd_spl_00005002-0001_u3am4.tar.gz; for requestToken: 710367dd-bb59-4f83-9c85-1aed5f4daead; result is: SRM_SPACE_AVAILABLE: srmPrepareToPut successfully handled!
> 12:56:01.278 - INFO [XML-RPC-11] - srmPutDone: <Grid User (VOMS) = DN:'OID.0.9.2342.19200300.100.1.25=ch, OID.0.9.2342.19200300.100.1.25=cern, OU=Organic Units, OU=Users, CN=lwikstro, CN=627993, CN=Gustav Wikstrom' FQANS:[/t2k.org/Role=production/Capability=NULL, /t2k.org/Role=NULL/Capability=NULL]> Request for [token:710367dd-bb59-4f83-9c85-1aed5f4daead] for [SURL:srm://se03.esc.qmul.ac.uk:8444/t2k.org/nd280/v8r5p11/cata/ND280/ND280/00005000_00005999/oa_nd_spl_00005002-0001_u3am4.tar.gz] successfully done with: [status:SRM_SUCCESS: ]
> 12:56:01.289 - INFO [XML-RPC-11] - srmPutDone: <Grid User (VOMS) = DN:'OID.0.9.2342.19200300.100.1.25=ch, OID.0.9.2342.19200300.100.1.25=cern, OU=Organic Units, OU=Users, CN=lwikstro, CN=627993, CN=Gustav Wikstrom' FQANS:[/t2k.org/Role=production/Capability=NULL, /t2k.org/Role=NULL/Capability=NULL]> Request for [token:710367dd-bb59-4f83-9c85-1aed5f4daead] for [SURL:'srm://se03.esc.qmul.ac.uk:8444/t2k.org/nd280/v8r5p11/cata/ND280/ND280/00005000_00005999/oa_nd_spl_00005002-0001_u3am4.tar.gz'] successfully done with: [status:SRM_SUCCESS: All file requests are successfully completed]
> 12:56:02.752 - INFO [pool-3-thread-2] - Handling PtP chunk for user DN: /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=lwikstro/CN=627993/CN=Gustav Wikstrom; for SURL: srm://se03.esc.qmul.ac.uk:8444/t2k.org/nd280/v8r5p11/cata/ND280/ND280/00005000_00005999/oa_nd_spl_00005002-0001_u3am4.tar.gz; for requestToken: f8923138-31eb-4d73-b35c-8a0e84b717b1
> 12:56:02.778 - INFO [pool-3-thread-2] - Finished handling PtP chunk for user DN: /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=lwikstro/CN=627993/CN=Gustav Wikstrom; for SURL: srm://se03.esc.qmul.ac.uk:8444/t2k.org/nd280/v8r5p11/cata/ND280/ND280/00005000_00005999/oa_nd_spl_00005002-0001_u3am4.tar.gz; for requestToken: f8923138-31eb-4d73-b35c-8a0e84b717b1; result is: SRM_DUPLICATION_ERROR: Cannot srmPut file because it already exists!
> 12:56:07.749 - INFO [pool-3-thread-6] - Handling PtP chunk for user DN: /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=lwikstro/CN=627993/CN=Gustav Wikstrom; for SURL: srm://se03.esc.qmul.ac.uk:8444/t2k.org/nd280/v8r5p11/cata/ND280/ND280/00005000_00005999/oa_nd_spl_00005002-0001_u3am4.tar.gz; for requestToken: b6bf3150-70bd-453c-98ab-a2d870a3f655
> 12:56:07.751 - INFO [pool-3-thread-6] - Finished handling PtP chunk for user DN: /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=lwikstro/CN=627993/CN=Gustav Wikstrom; for SURL: srm://se03.esc.qmul.ac.uk:8444/t2k.org/nd280/v8r5p11/cata/ND280/ND280/00005000_00005999/oa_nd_spl_00005002-0001_u3am4.tar.gz; for requestToken: b6bf3150-70bd-453c-98ab-a2d870a3f655; result is: SRM_DUPLICATION_ERROR: Cannot srmPut file because it already exists!
>
>
|