Bah! We're allowed to nuke old crusty dteam data. ;-)
Jensen, J (Jens) ([log in to unmask]) wrote:
> The same happened at RAL - data was migrated.
>
> What I think is curious is that the client tool segfaults, and it's the
> lcg-util tool.
>
> And if you look through the listing it looks more like it's the RHUL and
> UCL CCC SEs that make the client segfault, unless I misread it.
>
> In fact the error messages that come out of lcg-cp below are odd. Only
> two say "no such file or directory"
>
> Hmm..
> Cheers
> --jens
>
> Peter Love wrote:
> > Booby prize? Will wait for that in the post. We migrated data from
> > dcache to DPM and if someone can point us to dteam retention policy then
> > please do! (not that we'd defend dcache :-)
> >
> > Jensen, J (Jens) ([log in to unmask]) wrote:
> >> Another good one from Stephen Burke...
> >>
> >> -------- Original Message --------
> >> Subject: File persistency
> >> Date: Tue, 24 Jun 2008 13:07:19 +0100
> >> From: Burke, S (Stephen) <[log in to unmask]>
> >> To: GridPP Dteam <[log in to unmask]>
> >>
> >> Hi all,
> >>
> >> This is perhaps somewhat academic, but as the mail below shows, back in
> >> January 2006 I copied files to all the SEs then available. I always
> >> meant to check to see if they were still accessible but never got around
> >> to it until now. The results are below ... it seems the prizes go to
> >> RHUL, Oxford, RALPP, Brunel and Bristol, which have managed to preserve
> >> a file for 30 months! And booby prizes to RAL-T1 and Lancaster where the
> >> dcaches cause seg faults ...
> >>
> >> Stephen
> >>
> >>
> >> Source URL:
> >> srm://se1.pp.rhul.ac.uk/dpm/pp.rhul.ac.uk/home/dteam/generated/2006-01-1
> >> 6/filee7453837-358d-4557-b406-4dedc998ce08
> >> File size: 12
> >> Source URL for copy:
> >> gsiftp://gridraid4.pp.rhul.ac.uk/gridraid4.pp.rhul.ac.uk:/grid/pool/dtea
> >> m/2006-01-16/filee7453837-358d-4557-b406-4dedc998ce08.2159.0
> >> Destination URL: file:/tmp/qqq1
> >> # streams: 1
> >> # set timeout to 300 (seconds)
> >> 0 bytes 0.00 KB/sec avg 0.00 KB/sec inst
> >> Transfer took 2010 ms
> >>
> >> Segmentation fault
> >> lcg-cp -v -t 300 --vo dteam
> >> srm://dcache.gridpp.rl.ac.uk/pnfs/gridpp.rl.ac.uk/data/dteam/generated/2
> >> 006-01-16/filed1db97b0-8f3f-4b15-8c56-b76e329c827c file:/tmp/qqq2
> >>
> >> Source URL:
> >> srm://t2se01.physics.ox.ac.uk/dpm/physics.ox.ac.uk/home/dteam/generated/
> >> 2006-01-16/file48d7988a-b652-46c8-a98b-ff65ac869274
> >> File size: 12
> >> Source URL for copy:
> >> gsiftp://t2se04.physics.ox.ac.uk/t2se04.physics.ox.ac.uk:/dpm/pool4/dtea
> >> m/2008-02-05/file48d7988a-b652-46c8-a98b-ff65ac869274.854595.0
> >> Destination URL: file:/tmp/qqq3
> >> # streams: 1
> >> # set timeout to 300 (seconds)
> >> 0 bytes 0.00 KB/sec avg 0.00 KB/sec inst
> >> Transfer took 1010 ms
> >>
> >> Source URL:
> >> srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/dteam/generated/2006-0
> >> 1-16/filefbd67d09-4f35-432c-a638-140498849696
> >> File size: 12
> >> Source URL for copy:
> >> gsiftp://heplnx169.pp.rl.ac.uk:2811//pnfs/pp.rl.ac.uk/data/dteam/generat
> >> ed/2006-01-16/filefbd67d09-4f35-432c-a638-140498849696
> >> Destination URL: file:/tmp/qqq4
> >> # streams: 1
> >> # set timeout to 300 (seconds)
> >> 0 bytes 0.00 KB/sec avg 0.00 KB/sec inst
> >> Transfer took 1010 ms
> >>
> >> httpg://epgse1.ph.bham.ac.uk:8443/srm/managerv1: No such file or
> >> directory
> >> lcg_cp: No such file or directory
> >>
> >> [lcgse0.shef.ac.uk]
> >> lcg_cp: No such file or directory
> >>
> >> lcgbdii02.gridpp.rl.ac.uk:2170: No GlueSEName found for
> >> gallows.dur.scotgrid.ac.uk
> >> lcg_cp: Invalid argument
> >>
> >> httpg://hepgrid5.ph.liv.ac.uk:8443/srm/managerv1: at Tue Jun 24
> >> 12:07:58 BST 2008 state Pending : created
> >> RequestFileStatus#-2144235644 failed with error:[ at Tue Jun 24
> >> 12:07:58 BST 2008 state Failed : file not found : path
> >> /pnfs/ph.liv.ac.uk/data/dte
> >> lcg_cp: Communication error on send
> >>
> >> lcgbdii02.gridpp.rl.ac.uk:2170: No GlueSEName found for
> >> se01.esc.qmul.ac.uk
> >> lcg_cp: Invalid argument
> >>
> >> Source URL:
> >> sfn://dgc-grid-34.brunel.ac.uk/storage/for/LCG/dteam/generated/2006-01-1
> >> 6/filec812e82c-9b3f-408c-98d2-8ae083c8f084
> >> File size: 12
> >> Source URL for copy:
> >> gsiftp://dgc-grid-34.brunel.ac.uk/storage/for/LCG/dteam/generated/2006-0
> >> 1-16/filec812e82c-9b3f-408c-98d2-8ae083c8f084
> >> Destination URL: file:/tmp/qqq10
> >> # streams: 1
> >> # set timeout to 300 (seconds)
> >> 0 bytes 0.00 KB/sec avg 0.00 KB/sec inst
> >> Transfer took 1000 ms
> >>
> >> [gw38.hep.ph.ic.ac.uk]
> >> a system call failed (Connection refused)
> >> lcg_cp: Invalid argument
> >>
> >> [se1-gla.scotgrid.ac.uk]
> >> globus_ftp_control_connect: globus_libc_gethostbyname_r failed
> >> lcg_cp: Invalid argument
> >>
> >> lcgbdii02.gridpp.rl.ac.uk:2170: No GlueSEName found for
> >> se2-gla.scotgrid.ac.uk
> >> lcg_cp: Invalid argument
> >>
> >> Source URL:
> >> srm://lcgse01.phy.bris.ac.uk/dpm/phy.bris.ac.uk/home/dteam/generated/200
> >> 6-01-16/filef8f2f2c0-a439-4cac-bfce-b81e620f8f68
> >> File size: 12
> >> Source URL for copy:
> >> gsiftp://lcgse01.phy.bris.ac.uk/lcgse01.phy.bris.ac.uk:/storage/dteam/20
> >> 06-01-16/filef8f2f2c0-a439-4cac-bfce-b81e620f8f68.4967.0
> >> Destination URL: file:/tmp/qqq14
> >> # streams: 1
> >> # set timeout to 300 (seconds)
> >> 0 bytes 0.00 KB/sec avg 0.00 KB/sec inst
> >> Transfer took 1010 ms
> >>
> >> Segmentation fault
> >> lcg-cp -v -t 300 --vo dteam
> >> srm://dcache-tape.gridpp.rl.ac.uk/pnfs/gridpp.rl.ac.uk/tape/dteam/genera
> >> ted/2006-01-16/filebc01710d-1012-4850-bb56-367836f70a26 file:/tmp/qqq15
> >>
> >> lcgbdii02.gridpp.rl.ac.uk:2170: No GlueSEName found for
> >> dpm.epcc.ed.ac.uk
> >> lcg_cp: Invalid argument
> >>
> >> [fal-pygrid-03.lancs.ac.uk]
> >> a system call failed (Connection timed out)
> >> lcg_cp: Invalid argument
> >>
> >> [se-a.ccc.ucl.ac.uk]
> >> a system call failed (Connection timed out)
> >> lcg_cp: Invalid argument
> >>
> >> Segmentation fault
> >> lcg-cp -v -t 300 --vo dteam
> >> srm://fal-pygrid-20.lancs.ac.uk/pnfs/lancs.ac.uk/data/dteam/generated/20
> >> 06-01-16/filed089f8ec-326f-44c8-8d81-0e3589b225b3 file:/tmp/qqq19
> >>
> >> httpg://gfe02.hep.ph.ic.ac.uk:8443/srm/managerv1: at Tue Jun 24
> >> 12:24:48 BST 2008 state Pending : created
> >> RequestFileStatus#-2145949389 failed with error:[ at Tue Jun 24
> >> 12:24:49 BST 2008 state Failed : file not found : path
> >> /pnfs/hep.ph.ic.ac.uk/data/
> >> lcg_cp: Communication error on send
> >>
> >> httpg://srm.epcc.ed.ac.uk:8443/srm/managerv1: at Tue Jun 24 12:24:50
> >> BST 2008 state Pending : created
> >> RequestFileStatus#-2145859497 failed with error:[ at Tue Jun 24
> >> 12:24:50 BST 2008 state Failed : file not found : path
> >> /pnfs/epcc.ed.ac.uk/data/dteam/
> >> lcg_cp: Communication error on send
> >>
> >>
> >> -----Original Message-----
> >> From: Discussion list for the GridPP Deployment Team
> >> [mailto:[log in to unmask]] On Behalf Of Burke, S (Stephen)
> >> Sent: 16 January 2006 17:11
> >> To: [log in to unmask]
> >> Subject: [GRIDPP-DTEAM] More file security
> >>
> >> Hi *,
> >>
> >> For an ongoing check, I just put a file called
> >> lfn:burke.gridpp.performance.test.target.2006 on every SE currently
> >> visible in the info system - well, nearly all. Two give errors (Oxford
> >> and Cambridge!):
> >>
> >> lcg-rep --vo=dteam -d t2se02.physics.ox.ac.uk
> >> lfn:burke.gridpp.performance.test.target.2006
> >> CE Accesspoint not found
> >> lcg_rep: Invalid argument
> >>
> >> lcg-rep --vo=dteam -d serv02.hep.phy.cam.ac.uk
> >> lfn:burke.gridpp.performance.test.target.2006
> >> a system call failed (Connection reset by peer)
> >> lcg_rep: Transport endpoint is not connected
> >>
> >> And this one doesn't respond:
> >>
> >> ping pc55.hep.ucl.ac.uk
> >> PING pc55.hep.ucl.ac.uk (128.40.4.155) 56(84) bytes of data.
> >>
> >> --- pc55.hep.ucl.ac.uk ping statistics ---
> >> 6 packets transmitted, 0 received, 100% packet loss, time 5013ms
> >>
> >> Stephen
> >>
> >> lcg-lr --vo=dteam lfn:burke.gridpp.performance.test.target.2006
> >> srm://se1.pp.rhul.ac.uk/dpm/pp.rhul.ac.uk/home/dteam/generated/2006-01-1
> >> 6/filee7453837-358d-4557-b406-4dedc998ce08
> >> srm://dcache.gridpp.rl.ac.uk/pnfs/gridpp.rl.ac.uk/data/dteam/generated/2
> >> 006-01-16/filed1db97b0-8f3f-4b15-8c56-b76e329c827c
> >> srm://t2se01.physics.ox.ac.uk/dpm/physics.ox.ac.uk/home/dteam/generated/
> >> 2006-01-16/file48d7988a-b652-46c8-a98b-ff65ac869274
> >> srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/dteam/generated/2006-0
> >> 1-16/filefbd67d09-4f35-432c-a638-140498849696
> >> srm://epgse1.ph.bham.ac.uk/dpm/ph.bham.ac.uk/home/dteam/generated/2006-0
> >> 1-16/file4e8049b5-62f1-4fcb-8046-1d4f160d54fd
> >> sfn://lcgse0.shef.ac.uk/storage/dteam/generated/2006-01-16/filed4385476-
> >> af06-4d8f-81f9-a9f5174f2f48
> >> srm://gallows.dur.scotgrid.ac.uk/dpm/dur.scotgrid.ac.uk/home/dteam/gener
> >> ated/2006-01-16/file497877ef-f2d6-438d-a9eb-e361b9ef08bd
> >> srm://hepgrid5.ph.liv.ac.uk/pnfs/ph.liv.ac.uk/data/dteam/generated/2006-
> >> 01-16/file3700117b-98db-418f-945b-9adb77892820
> >> srm://se01.esc.qmul.ac.uk/dpm/esc.qmul.ac.uk/home/dteam/generated/2006-0
> >> 1-16/fileb3e22b9f-904b-44f0-91b3-f73af4a86e33
> >> sfn://dgc-grid-34.brunel.ac.uk/storage/for/LCG/dteam/generated/2006-01-1
> >> 6/filec812e82c-9b3f-408c-98d2-8ae083c8f084
> >> sfn://gw38.hep.ph.ic.ac.uk/stage2/lcg2-data/dteam/generated/2006-01-16/f
> >> ilea9dcac62-6ab7-4271-a90e-dc52dfe52c70
> >> sfn://se1-gla.scotgrid.ac.uk/gridstorage/dteam/generated/2006-01-16/file
> >> cf570b0b-d238-413e-a4c8-ee110b3e6495
> >> srm://se2-gla.scotgrid.ac.uk/dpm/scotgrid.ac.uk/home/dteam/generated/200
> >> 6-01-16/file7c0a8dd9-a415-48c8-9245-ae5f39435078
> >> srm://lcgse01.phy.bris.ac.uk/dpm/phy.bris.ac.uk/home/dteam/generated/200
> >> 6-01-16/filef8f2f2c0-a439-4cac-bfce-b81e620f8f68
> >> srm://dcache-tape.gridpp.rl.ac.uk/pnfs/gridpp.rl.ac.uk/tape/dteam/genera
> >> ted/2006-01-16/filebc01710d-1012-4850-bb56-367836f70a26
> >> srm://dpm.epcc.ed.ac.uk/dpm/epcc.ed.ac.uk/home/dteam/generated/2006-01-1
> >> 6/file22c53883-c98b-4fe5-bdf6-5666d1d3c71f
> >> sfn://fal-pygrid-03.lancs.ac.uk/storage/dteam/generated/2006-01-16/filed
> >> 6c39b82-6c7d-4041-8ab8-843314d4735e
> >> sfn://se-a.ccc.ucl.ac.uk/nfs/ccc/lcgSE/dteam/generated/2006-01-16/fileb3
> >> 219cbe-299a-4872-9a36-0433c2327fd6
> >> srm://fal-pygrid-20.lancs.ac.uk/pnfs/lancs.ac.uk/data/dteam/generated/20
> >> 06-01-16/filed089f8ec-326f-44c8-8d81-0e3589b225b3
> >> srm://gfe02.hep.ph.ic.ac.uk/pnfs/hep.ph.ic.ac.uk/data/dteam/generated/20
> >> 06-01-16/file6c78fc22-f88a-49bf-ada5-a1a6b42b327e
> >> srm://srm.epcc.ed.ac.uk/pnfs/epcc.ed.ac.uk/data/dteam/generated/2006-01-
> >> 16/filef0d9f978-7140-4ff3-8065-b07226492cc8
|