In some cases (ahem) it even survived some array rebuilds and changes
of physical storage 8-).
On 24 Jun 2008, at 14:34, Peter Love wrote:
> Booby prize? Will wait for that in the post. We migrated data from
> dcache to DPM and if someone can point us to dteam retention policy
> then
> please do! (not that we'd defend dcache :-)
>
> Jensen, J (Jens) ([log in to unmask]) wrote:
>> Another good one from Stephen Burke...
>>
>> -------- Original Message --------
>> Subject: File persistency
>> Date: Tue, 24 Jun 2008 13:07:19 +0100
>> From: Burke, S (Stephen) <[log in to unmask]>
>> To: GridPP Dteam <[log in to unmask]>
>>
>> Hi all,
>>
>> This is perhaps somewhat academic, but as the mail below shows,
>> back in
>> January 2006 I copied files to all the SEs then available. I always
>> meant to check to see if they were still accessible but never got
>> around
>> to it until now. The results are below ... it seems the prizes go to
>> RHUL, Oxford, RALPP, Brunel and Bristol, which have managed to
>> preserve
>> a file for 30 months! And booby prizes to RAL-T1 and Lancaster
>> where the
>> dcaches cause seg faults ...
>>
>> Stephen
>>
>>
>> Source URL:
>> srm://se1.pp.rhul.ac.uk/dpm/pp.rhul.ac.uk/home/dteam/generated/
>> 2006-01-1
>> 6/filee7453837-358d-4557-b406-4dedc998ce08
>> File size: 12
>> Source URL for copy:
>> gsiftp://gridraid4.pp.rhul.ac.uk/gridraid4.pp.rhul.ac.uk:/grid/pool/dtea
>> m/2006-01-16/filee7453837-358d-4557-b406-4dedc998ce08.2159.0
>> Destination URL: file:/tmp/qqq1
>> # streams: 1
>> # set timeout to 300 (seconds)
>> 0 bytes 0.00 KB/sec avg 0.00 KB/sec inst
>> Transfer took 2010 ms
>>
>> Segmentation fault
>> lcg-cp -v -t 300 --vo dteam
>> srm://dcache.gridpp.rl.ac.uk/pnfs/gridpp.rl.ac.uk/data/dteam/
>> generated/2
>> 006-01-16/filed1db97b0-8f3f-4b15-8c56-b76e329c827c file:/tmp/qqq2
>>
>> Source URL:
>> srm://t2se01.physics.ox.ac.uk/dpm/physics.ox.ac.uk/home/dteam/
>> generated/
>> 2006-01-16/file48d7988a-b652-46c8-a98b-ff65ac869274
>> File size: 12
>> Source URL for copy:
>> gsiftp://t2se04.physics.ox.ac.uk/t2se04.physics.ox.ac.uk:/dpm/pool4/dtea
>> m/2008-02-05/file48d7988a-b652-46c8-a98b-ff65ac869274.854595.0
>> Destination URL: file:/tmp/qqq3
>> # streams: 1
>> # set timeout to 300 (seconds)
>> 0 bytes 0.00 KB/sec avg 0.00 KB/sec inst
>> Transfer took 1010 ms
>>
>> Source URL:
>> srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/dteam/generated/
>> 2006-0
>> 1-16/filefbd67d09-4f35-432c-a638-140498849696
>> File size: 12
>> Source URL for copy:
>> gsiftp://heplnx169.pp.rl.ac.uk:2811//pnfs/pp.rl.ac.uk/data/dteam/generat
>> ed/2006-01-16/filefbd67d09-4f35-432c-a638-140498849696
>> Destination URL: file:/tmp/qqq4
>> # streams: 1
>> # set timeout to 300 (seconds)
>> 0 bytes 0.00 KB/sec avg 0.00 KB/sec inst
>> Transfer took 1010 ms
>>
>> httpg://epgse1.ph.bham.ac.uk:8443/srm/managerv1: No such file or
>> directory
>> lcg_cp: No such file or directory
>>
>> [lcgse0.shef.ac.uk]
>> lcg_cp: No such file or directory
>>
>> lcgbdii02.gridpp.rl.ac.uk:2170: No GlueSEName found for
>> gallows.dur.scotgrid.ac.uk
>> lcg_cp: Invalid argument
>>
>> httpg://hepgrid5.ph.liv.ac.uk:8443/srm/managerv1: at Tue Jun 24
>> 12:07:58 BST 2008 state Pending : created
>> RequestFileStatus#-2144235644 failed with error:[ at Tue Jun 24
>> 12:07:58 BST 2008 state Failed : file not found : path
>> /pnfs/ph.liv.ac.uk/data/dte
>> lcg_cp: Communication error on send
>>
>> lcgbdii02.gridpp.rl.ac.uk:2170: No GlueSEName found for
>> se01.esc.qmul.ac.uk
>> lcg_cp: Invalid argument
>>
>> Source URL:
>> sfn://dgc-grid-34.brunel.ac.uk/storage/for/LCG/dteam/generated/
>> 2006-01-1
>> 6/filec812e82c-9b3f-408c-98d2-8ae083c8f084
>> File size: 12
>> Source URL for copy:
>> gsiftp://dgc-grid-34.brunel.ac.uk/storage/for/LCG/dteam/generated/2006-0
>> 1-16/filec812e82c-9b3f-408c-98d2-8ae083c8f084
>> Destination URL: file:/tmp/qqq10
>> # streams: 1
>> # set timeout to 300 (seconds)
>> 0 bytes 0.00 KB/sec avg 0.00 KB/sec inst
>> Transfer took 1000 ms
>>
>> [gw38.hep.ph.ic.ac.uk]
>> a system call failed (Connection refused)
>> lcg_cp: Invalid argument
>>
>> [se1-gla.scotgrid.ac.uk]
>> globus_ftp_control_connect: globus_libc_gethostbyname_r failed
>> lcg_cp: Invalid argument
>>
>> lcgbdii02.gridpp.rl.ac.uk:2170: No GlueSEName found for
>> se2-gla.scotgrid.ac.uk
>> lcg_cp: Invalid argument
>>
>> Source URL:
>> srm://lcgse01.phy.bris.ac.uk/dpm/phy.bris.ac.uk/home/dteam/
>> generated/200
>> 6-01-16/filef8f2f2c0-a439-4cac-bfce-b81e620f8f68
>> File size: 12
>> Source URL for copy:
>> gsiftp://lcgse01.phy.bris.ac.uk/lcgse01.phy.bris.ac.uk:/storage/dteam/20
>> 06-01-16/filef8f2f2c0-a439-4cac-bfce-b81e620f8f68.4967.0
>> Destination URL: file:/tmp/qqq14
>> # streams: 1
>> # set timeout to 300 (seconds)
>> 0 bytes 0.00 KB/sec avg 0.00 KB/sec inst
>> Transfer took 1010 ms
>>
>> Segmentation fault
>> lcg-cp -v -t 300 --vo dteam
>> srm://dcache-tape.gridpp.rl.ac.uk/pnfs/gridpp.rl.ac.uk/tape/dteam/
>> genera
>> ted/2006-01-16/filebc01710d-1012-4850-bb56-367836f70a26 file:/tmp/
>> qqq15
>>
>> lcgbdii02.gridpp.rl.ac.uk:2170: No GlueSEName found for
>> dpm.epcc.ed.ac.uk
>> lcg_cp: Invalid argument
>>
>> [fal-pygrid-03.lancs.ac.uk]
>> a system call failed (Connection timed out)
>> lcg_cp: Invalid argument
>>
>> [se-a.ccc.ucl.ac.uk]
>> a system call failed (Connection timed out)
>> lcg_cp: Invalid argument
>>
>> Segmentation fault
>> lcg-cp -v -t 300 --vo dteam
>> srm://fal-pygrid-20.lancs.ac.uk/pnfs/lancs.ac.uk/data/dteam/
>> generated/20
>> 06-01-16/filed089f8ec-326f-44c8-8d81-0e3589b225b3 file:/tmp/qqq19
>>
>> httpg://gfe02.hep.ph.ic.ac.uk:8443/srm/managerv1: at Tue Jun 24
>> 12:24:48 BST 2008 state Pending : created
>> RequestFileStatus#-2145949389 failed with error:[ at Tue Jun 24
>> 12:24:49 BST 2008 state Failed : file not found : path
>> /pnfs/hep.ph.ic.ac.uk/data/
>> lcg_cp: Communication error on send
>>
>> httpg://srm.epcc.ed.ac.uk:8443/srm/managerv1: at Tue Jun 24 12:24:50
>> BST 2008 state Pending : created
>> RequestFileStatus#-2145859497 failed with error:[ at Tue Jun 24
>> 12:24:50 BST 2008 state Failed : file not found : path
>> /pnfs/epcc.ed.ac.uk/data/dteam/
>> lcg_cp: Communication error on send
>>
>>
>> -----Original Message-----
>> From: Discussion list for the GridPP Deployment Team
>> [mailto:[log in to unmask]] On Behalf Of Burke, S (Stephen)
>> Sent: 16 January 2006 17:11
>> To: [log in to unmask]
>> Subject: [GRIDPP-DTEAM] More file security
>>
>> Hi *,
>>
>> For an ongoing check, I just put a file called
>> lfn:burke.gridpp.performance.test.target.2006 on every SE currently
>> visible in the info system - well, nearly all. Two give errors
>> (Oxford
>> and Cambridge!):
>>
>> lcg-rep --vo=dteam -d t2se02.physics.ox.ac.uk
>> lfn:burke.gridpp.performance.test.target.2006
>> CE Accesspoint not found
>> lcg_rep: Invalid argument
>>
>> lcg-rep --vo=dteam -d serv02.hep.phy.cam.ac.uk
>> lfn:burke.gridpp.performance.test.target.2006
>> a system call failed (Connection reset by peer)
>> lcg_rep: Transport endpoint is not connected
>>
>> And this one doesn't respond:
>>
>> ping pc55.hep.ucl.ac.uk
>> PING pc55.hep.ucl.ac.uk (128.40.4.155) 56(84) bytes of data.
>>
>> --- pc55.hep.ucl.ac.uk ping statistics ---
>> 6 packets transmitted, 0 received, 100% packet loss, time 5013ms
>>
>> Stephen
>>
>> lcg-lr --vo=dteam lfn:burke.gridpp.performance.test.target.2006
>> srm://se1.pp.rhul.ac.uk/dpm/pp.rhul.ac.uk/home/dteam/generated/
>> 2006-01-1
>> 6/filee7453837-358d-4557-b406-4dedc998ce08
>> srm://dcache.gridpp.rl.ac.uk/pnfs/gridpp.rl.ac.uk/data/dteam/
>> generated/2
>> 006-01-16/filed1db97b0-8f3f-4b15-8c56-b76e329c827c
>> srm://t2se01.physics.ox.ac.uk/dpm/physics.ox.ac.uk/home/dteam/
>> generated/
>> 2006-01-16/file48d7988a-b652-46c8-a98b-ff65ac869274
>> srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/dteam/generated/
>> 2006-0
>> 1-16/filefbd67d09-4f35-432c-a638-140498849696
>> srm://epgse1.ph.bham.ac.uk/dpm/ph.bham.ac.uk/home/dteam/generated/
>> 2006-0
>> 1-16/file4e8049b5-62f1-4fcb-8046-1d4f160d54fd
>> sfn://lcgse0.shef.ac.uk/storage/dteam/generated/2006-01-16/
>> filed4385476-
>> af06-4d8f-81f9-a9f5174f2f48
>> srm://gallows.dur.scotgrid.ac.uk/dpm/dur.scotgrid.ac.uk/home/dteam/
>> gener
>> ated/2006-01-16/file497877ef-f2d6-438d-a9eb-e361b9ef08bd
>> srm://hepgrid5.ph.liv.ac.uk/pnfs/ph.liv.ac.uk/data/dteam/generated/
>> 2006-
>> 01-16/file3700117b-98db-418f-945b-9adb77892820
>> srm://se01.esc.qmul.ac.uk/dpm/esc.qmul.ac.uk/home/dteam/generated/
>> 2006-0
>> 1-16/fileb3e22b9f-904b-44f0-91b3-f73af4a86e33
>> sfn://dgc-grid-34.brunel.ac.uk/storage/for/LCG/dteam/generated/
>> 2006-01-1
>> 6/filec812e82c-9b3f-408c-98d2-8ae083c8f084
>> sfn://gw38.hep.ph.ic.ac.uk/stage2/lcg2-data/dteam/generated/
>> 2006-01-16/f
>> ilea9dcac62-6ab7-4271-a90e-dc52dfe52c70
>> sfn://se1-gla.scotgrid.ac.uk/gridstorage/dteam/generated/2006-01-16/
>> file
>> cf570b0b-d238-413e-a4c8-ee110b3e6495
>> srm://se2-gla.scotgrid.ac.uk/dpm/scotgrid.ac.uk/home/dteam/
>> generated/200
>> 6-01-16/file7c0a8dd9-a415-48c8-9245-ae5f39435078
>> srm://lcgse01.phy.bris.ac.uk/dpm/phy.bris.ac.uk/home/dteam/
>> generated/200
>> 6-01-16/filef8f2f2c0-a439-4cac-bfce-b81e620f8f68
>> srm://dcache-tape.gridpp.rl.ac.uk/pnfs/gridpp.rl.ac.uk/tape/dteam/
>> genera
>> ted/2006-01-16/filebc01710d-1012-4850-bb56-367836f70a26
>> srm://dpm.epcc.ed.ac.uk/dpm/epcc.ed.ac.uk/home/dteam/generated/
>> 2006-01-1
>> 6/file22c53883-c98b-4fe5-bdf6-5666d1d3c71f
>> sfn://fal-pygrid-03.lancs.ac.uk/storage/dteam/generated/2006-01-16/
>> filed
>> 6c39b82-6c7d-4041-8ab8-843314d4735e
>> sfn://se-a.ccc.ucl.ac.uk/nfs/ccc/lcgSE/dteam/generated/2006-01-16/
>> fileb3
>> 219cbe-299a-4872-9a36-0433c2327fd6
>> srm://fal-pygrid-20.lancs.ac.uk/pnfs/lancs.ac.uk/data/dteam/
>> generated/20
>> 06-01-16/filed089f8ec-326f-44c8-8d81-0e3589b225b3
>> srm://gfe02.hep.ph.ic.ac.uk/pnfs/hep.ph.ic.ac.uk/data/dteam/
>> generated/20
>> 06-01-16/file6c78fc22-f88a-49bf-ada5-a1a6b42b327e
>> srm://srm.epcc.ed.ac.uk/pnfs/epcc.ed.ac.uk/data/dteam/generated/
>> 2006-01-
>> 16/filef0d9f978-7140-4ff3-8065-b07226492cc8
|