And, of course, caveat for spacetokens in general: this only counts
stuff written into them, so if t2k wrote stuff into generic space,
then my and Chris's methods will miss it.
On Thu, 14 Feb 2019 at 15:18, Chris Brew - UKRI STFC
<[log in to unmask]> wrote:
>
> Hi,
>
> The space option to lcg-infosites should get the space token info for all sites rather than querying each one:
>
> $ lcg-infosites --vo t2k.org space
> Free Used Reserved Free Used Reserved Tag SE
> Online Online Online Nearline Nearline Nearline
> -------------------------------------------------------------------------------
> 234439 1065772 0 0 0 0 - bohr3226.tier2.hep.manchester.ac.uk
> 0 0 0 0 0 0 - bohr3226.tier2.hep.manchester.ac.uk
> 12171 19714 31885 0 0 0 T2KORGDISK fal-pygrid-30.lancs.ac.uk
> 53 0 53 0 0 0 dteam fal-pygrid-30.lancs.ac.uk
> 173722 0 173722 0 0 0 generic atlas fal-pygrid-30.lancs.ac.uk
> 53 0 53 0 0 0 gridpp fal-pygrid-30.lancs.ac.uk
> 53 0 53 0 0 0 lhcb fal-pygrid-30.lancs.ac.uk
> 17948 1911 0 0 0 0 - fal-pygrid-30.lancs.ac.uk
> 15215 31217 0 0 0 0 - gfe02.grid.hep.ph.ic.ac.uk
> 75789 37225 113015 0 0 0 T2KORGDISK gfe02.grid.hep.ph.ic.ac.uk
> 4370 11629 16000 0 0 0 T2KLIVERPOOLDISK hepgrid11.ph.liv.ac.uk
> 0 6679 0 0 0 0 - hepgrid11.ph.liv.ac.uk
> 42 13532 0 0 0 0 - hepgrid11.ph.liv.ac.uk
> 68200 91787 0 0 0 0 - heplnx204.pp.rl.ac.uk
> 1631 8369 10000 0 0 0 T2K_DEFAULT heplnx204.pp.rl.ac.uk
> 59411 20589 80000 0 0 0 - kek2-se01.cc.kek.jp
> 5208 3875 0 0 0 0 - lcgse0.shef.ac.uk
> 33394 32576 65970 0 0 0 BASE polgrid4.in2p3.fr
> 20346 5763 0 0 0 0 - polgrid4.in2p3.fr
> 93044 106956 200000 0 0 0 T2KORGDISK se03.esc.qmul.ac.uk
> 4130 6976 11107 18326 812063 886112 - srm-t2k.gridpp.rl.ac.uk
> 4130 6976 11107 18326 812063 886112 T2KORGDISK srm-t2k.gridpp.rl.ac.uk
> 900 100 1000 0 0 0 T2KIFAEDISK srm.pic.es
> 998 29002 30000 0 0 0 T2KORGDISK srm.pic.es
> 188 1012 1200 0 0 0 - srmv2.ific.uv.es
> 581 1419 2000 0 0 0 T2KORGDISK srmv2.ific.uv.es
> 10 10 20 0 0 0 - storm-se-01.ba.infn.it
> 17984 468048 0 0 0 0 - t2ksrm.nd280.org
> 2199 0 2199 0 0 0 T2KORGDISK t2se01.physics.ox.ac.uk
> 18676 95667 0 0 0 0 - t2se01.physics.ox.ac.uk
>
> That number more-or-less agrees with the number Katy got for the Tier 1 and for RALPP.
>
> As Sam says, in theory the APEL storage accounting should be the place to look:
>
> http://accounting-devel.egi.eu/storage.php?query=logical_tb_used_avg&startYear=2019&startMonth=2&endYear=2019&endMonth=2&yrange=SITE&xrange=VO&groupVO=all&chart=GRBAR&scale=LIN&localJobs=onlygridjobs
>
> but that looks completely inaccurate.
>
> Chris.
>
> On 14/02/2019, 15:05, "Testbed Support for GridPP member institutes on behalf of Sam Skipsey" <[log in to unmask] on behalf of [log in to unmask]> wrote:
>
> Hi Raja:
>
> My understanding of lcg-infosites (and lcg-info) is that it only
> reports the space in the "pool" available to the VO (so, in this case,
> if the pool is shared with other VOs, it won't report exactly how much
> space is being used by t2k by themselves).
>
> I believe, if t2k are using a spacetoken, then for sites with an SRM,
> the "better/more reliable" approach would be to find the space token
>
> eg, for UKI-SCOTGRID-GLASGOW
>
> srm-get-space-tokens srm://svr018.gla.scotgrid.ac.uk (or other endpoint)
>
> and then examine the space in the token that t2k is using:
>
> srm-get-space-metadata -space_tokens=NAMEOFTOKEN srm://svr018.gla.scotgrid.ac.uk
>
> [of course, you'd need a valid proxy etc for this to work]
>
>
> Technically, this is all supposed to now be provided by the new
> storage resource monitoring portal, but I've never really had much
> luck getting accurate answers out of it.
>
> Sam
>
> On Thu, 14 Feb 2019 at 14:52, Raja Nandakumar <[log in to unmask]> wrote:
> >
> > Hi Steve,
> >
> > Were you looking for something like the following ...
> >
> > Cheers,
> > Raja.
> >
> > [nraja@mercury005 ~]$ lcg-infosites --vo T2K se
> > Avail Space(kB) Used Space(kB) Type SE
> > ------------------------------------------
> > 5203558465 3880363949 SRM lcgse0.shef.ac.uk
> > 18676912541 95667050394 SRM t2se01.physics.ox.ac.uk
> > [nraja@mercury005 ~]$
> > [nraja@mercury005 ~]$ lcg-infosites --vo t2k.org se
> > Avail Space(kB) Used Space(kB) Type SE
> > ------------------------------------------
> > 234067740571 1065767377321 SRM bohr3226.tier2.hep.manchester.ac.uk
> > n.a n.a SRM bohr3226.tier2.hep.manchester.ac.uk
> > 12171448425 19714388779 SRM fal-pygrid-30.lancs.ac.uk
> > 53687090 n.a SRM fal-pygrid-30.lancs.ac.uk
> > 173722837181 6 SRM fal-pygrid-30.lancs.ac.uk
> > 53687091 n.a SRM fal-pygrid-30.lancs.ac.uk
> > 53687084 6 SRM fal-pygrid-30.lancs.ac.uk
> > 17948682643 1911254521 SRM fal-pygrid-30.lancs.ac.uk
> > 15215019071 31217184500 SRM gfe02.grid.hep.ph.ic.ac.uk
> > n.a n.a SRM gfe02.grid.hep.ph.ic.ac.uk
> > 4370231170 11629768829 SRM hepgrid11.ph.liv.ac.uk
> > n.a 6679131805 SRM hepgrid11.ph.liv.ac.uk
> > 42386043 13532132996 SRM hepgrid11.ph.liv.ac.uk
> > 68199555048 91787343024 SRM heplnx204.pp.rl.ac.uk
> > n.a n.a SRM heplnx204.pp.rl.ac.uk
> > 59410929934 20589070066 SRM kek2-se01.cc.kek.jp
> > 5203556684 3880365730 SRM lcgse0.shef.ac.uk
> > 33394276972 32576420693 SRM polgrid4.in2p3.fr
> > 20346893388 5763470455 SRM polgrid4.in2p3.fr
> > 93043480685 106956519315 SRM se03.esc.qmul.ac.uk
> > 22457183694 819039760192 SRM srm-t2k.gridpp.rl.ac.uk
> > n.a n.a SRM srm.pic.es
> > 187968349 1012031651 SRM srmv2.ific.uv.es
> > 581335400 1418664600 SRM srmv2.ific.uv.es
> > 10000000 10000000 SRM storm-se-01.ba.infn.it
> > 17984234328 468047518888 SRM t2ksrm.nd280.org
> > 2199023255 n.a SRM t2se01.physics.ox.ac.uk
> > 18676912541 95667050394 SRM t2se01.physics.ox.ac.uk
> > [nraja@mercury005 ~]$
> >
> >
> > On 14/02/2019 14:20, Steve Lloyd wrote:
> > > Hi,
> > > Does anyone know the answer to this?
> > > Cheers
> > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > > Steve Lloyd
> > > Emeritus Professor, School of Physics and Astronomy
> > > Queen Mary University of London, Mile End Road, London E1 4NS, UK
> > > E-mail: [log in to unmask]
> > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > >
> > >> Hi Steve
> > >>
> > >> I'm trying to find out how much storage T2K currently uses on the GRID,
> > >> I guess by obtaining a number for each location. Apart from emailing
> > >> the site admin at each location, is there a simple way for me to find
> > >> this out? Dan said you'd be a good person to ask. Any info/tips would
> > >> be much appreciated.
> > >>
> > >> Cheers
> > >>
> > >
> > > ########################################################################
> > >
> > > To unsubscribe from the TB-SUPPORT list, click the following link:
> > > https://www.jiscmail.ac.uk/cgi-bin/webadmin?SUBED1=TB-SUPPORT&A=1
> > >
> >
> > ########################################################################
> >
> > To unsubscribe from the TB-SUPPORT list, click the following link:
> > https://www.jiscmail.ac.uk/cgi-bin/webadmin?SUBED1=TB-SUPPORT&A=1
>
> ########################################################################
>
> To unsubscribe from the TB-SUPPORT list, click the following link:
> https://www.jiscmail.ac.uk/cgi-bin/webadmin?SUBED1=TB-SUPPORT&A=1
>
>
> ########################################################################
>
> To unsubscribe from the TB-SUPPORT list, click the following link:
> https://www.jiscmail.ac.uk/cgi-bin/webadmin?SUBED1=TB-SUPPORT&A=1
########################################################################
To unsubscribe from the TB-SUPPORT list, click the following link:
https://www.jiscmail.ac.uk/cgi-bin/webadmin?SUBED1=TB-SUPPORT&A=1
|