Hi Patricia and Stephen,
When I do an ldapsearch on our own bdii mu3.matrix.sara.nl and
lcgbdii02.gridpp.rl.ac.uk I get:
[ron@mu7 ron]$ time ldapsearch -x -h mu3.matrix.sara.nl -b
"mds-vo-name=local,o=grid" -p 2170 >/tmp/pipo
real 0m1.195s
user 0m0.720s
sys 0m0.070s
[ron@mu7 ron]$ lcgbdii02.gridpp.rl.ac.uk
[ron@mu7 ron]$ time ldapsearch -x -h lcgbdii02.gridpp.rl.ac.uk -b
"mds-vo-name=local,o=grid" -p 2170 >/tmp/pipo2
real 0m0.979s
user 0m0.680s
sys 0m0.000s
Which is rather similar and both bdii's contain almost the same amount
of information. However, when I do the following lcg-infosites commands
I get:
[ron@mu7 ron]$ time /opt/lcg/bin/lcg-infosites --vo cms se --is
mu3.matrix.sara.nl:2170 >/tmp/pipo
real 1m37.624s
user 0m1.850s
sys 0m0.500s
[ron@mu7 ron]$ time /opt/lcg/bin/lcg-infosites --vo cms se --is
lcgbdii02.gridpp.rl.ac.uk:2170 >/tmp/pipo2
real 0m10.473s
user 0m1.860s
sys 0m0.420s
This is quite a difference. However, it appears that the difference is
caused by diffences in response times of the bdii's:
[ron@mu7 ron]$ time ldapsearch -LLL -x -h lcgbdii02.gridpp.rl.ac.uk:2170
-p 2170 -b o=grid
'(&(ObjectClass=GlueSLTop)(GlueForeignKey=GlueSEUniqueID=lxfs04.jinr.ru)
)' GlueSLArchitectureType
dn:
GlueSLUniqueID=lxfs04.jinr.ru,Mds-Vo-name=rujinrlcg2,mds-vo-name=local,o
=g
rid
GlueSLArchitectureType: disk
real 0m0.099s
user 0m0.020s
sys 0m0.000s
[ron@mu7 ron]$ time ldapsearch -LLL -x -h mu3.matrix.sara.nl:2170 -p
2170 -b o=grid
'(&(ObjectClass=GlueSLTop)(GlueForeignKey=GlueSEUniqueID=lxfs04.jinr.ru)
)' GlueSLArchitectureType
dn:
GlueSLUniqueID=lxfs04.jinr.ru,Mds-Vo-name=rujinrlcg2,mds-vo-name=local,o
=g
rid
GlueSLArchitectureType: disk
real 0m0.722s
user 0m0.020s
sys 0m0.000s
The only question now is, why is mu3.matrix.sara.nl:2170 so slow? It's a
3 GHz dual XEON machine with 2 GB of memory running both the RB and the
BDII. Any ideas?
Cheers,
Ron
<[log in to unmask]>
> -----Original Message-----
> From: LHC Computer Grid - Rollout
> [mailto:[log in to unmask]] On Behalf Of Patricia
> Mendez Lorenzo
> Sent: maandag 14 februari 2005 14:24
> To: [log in to unmask]
> Subject: Re: [LCG-ROLLOUT] lcg-infosites takes forever to complete
>
> Hello,
>
> I get these results:
>
> time /opt/lcg/bin/lcg-infosites --vo cms se --is atlas-bdii
>
> **************************************************************
> These are the related data for cms: (in terms of SE)
> **************************************************************
>
> Avail Space(Kb) Used Space(Kb) Type SEs
> ----------------------------------------------------------
> 69501256, 3514180 disk se01.lip.pt
> 231010476 337690452 disk teras.sara.nl
> 1000000000000 500000000000 mss lcgse03.ifae.es
> 1000000000000 500000000000 mss lcgse05.ifae.es
> 364974260 80808 disk cms10.fuw.edu.pl
> 32633372 3344388 disk se001.imbm.bas.bg
> 1000000000000 500000000000 mss castorgrid.ifae.es
> 13415712 59042920 disk lcg03.ciemat.es
> 60968612 10049540 disk se001.grid.bas.bg
> 1000000000000 500000000000 mss castorgrid.cern.ch
> 152149224 704811416 disk mu2.matrix.sara.nl
> 115173368 670027744 disk grid001.pi.infn.it
> 1454113344 6087780 disk grid100.kfki.hu
> 65897344 6584184 disk se.keldysh.ru
> 46650528 3150492 disk se1.egee.fr.cgg.com
> 1829656844 317167348 disk cclcgseli01.in2p3.fr
> 999999999 0 disk cclcgseli02.in2p3.fr
> 2504416 24364820 disk grid2.fe.infn.it
> 976083880 4242904 disk ibelieve-i.hpc2n.umu.se
> 945372284 9813452 disk seitep.itep.ru
> 206710740 1240906608 disk t2-se-02.lnl.infn.it
> 51426744 4146200 disk castorftp.cnaf.infn.it
> 286518768 610893064 disk cmsbose1.bo.infn.it
> 1338045984 494064932 disk cmsbose2.bo.infn.it
> 34199084 1778676 disk lcg2se.tifrgrid.res.in
> 226574596 1578260 disk node004.grid.auth.gr
> 65100172 9677308 disk boalice1.bo.infn.it
> 102463172 9179908 disk grid003.ca.infn.it
> 1000000000000 500000000000 mss castorsrm.cr.cnaf.infn.it
> 1587581516 37332792 disk se001.m45.ihep.su
> 3421942528 6446336 disk se01.isabella.grnet.gr
> 1227081176 920246312 disk zeus03.cyf-kr.edu.pl
> 1000000000000 500000000000 mss castorgrid.cr.cnaf.infn.it
> 231361796 1371738752 disk grid002.mi.infn.it
> 106145864 2839384 rfio castor.grid.sinica.edu.tw
> 10000000000 5000000000 disk castorftp-1.cr.cnaf.infn.it
> 1470757032 132343516 disk t2-se-01.mi.infn.it
> 356800640 100033184 disk barentz.datagrid.jussieu.fr
> 190138312 101919952 disk lcg13.sinp.msu.ru
> 10000000000 5000000000 disk castorftp-cms.cr.cnaf.infn.it
> 1264056948 693542992 disk lcg00123.grid.sinica.edu.tw
> n.a n.a disk diskserv-cms-2.cr.cnaf.infn.it
> 107789824 7852288512 disk diskserv-lhc-2.cr.cnaf.infn.it
> 1915261116 713044 disk gallows.dur.scotgrid.ac.uk
> 357218844 555382860 disk griditse01.na.infn.it
> 58022352 13992228 disk se01.novsu.ac.ru
> 29641836 3798876 disk serv02.hep.phy.cam.ac.uk
> 223369508 35881252 disk
> ekp-lcg-se.physik.uni-karlsruhe.de
> 49232708 15834008 mss node1.egee.man.poznan.pl
> 1000000000000 500000000000 disk castorsrm.ifae.es
> 27929516 n.a mss accip41.physik.rwth-aachen.de
> 1000000000000 500000000000 disk castorsrm.cern.ch
> 721160000 61710000 se002.m45.ihep.su
>
> real 0m6.335s
> user 0m2.520s
> sys 0m0.890s
>
>
> And
>
> time /opt/lcg/bin/lcg-infosites --vo cms ce --is atlas-bdii
>
>
> ****************************************************************
> These are the related data for cms: (in terms of queues and CPUs)
> ****************************************************************
>
> #CPU Free Total Jobs Running Waiting ComputingElement
> ----------------------------------------------------------
> 8 8 0 2 0
> ce01.lip.pt:2119/jobmanager-torque-cms
> 8 5 0 0 0
> ce001.imbm.bas.bg:2119/jobmanager-pbs-long
> 180 22 18 0 0
> lcgce02.ifae.es:2119/jobmanager-lcgpbs-cms
> 57 0 40 18 40
> cclcgceli01.in2p3.fr:2119/jobmanager-bqs-A
> 57 55 0 0 0
> cclcgceli01.in2p3.fr:2119/jobmanager-bqs-G
> 93 0 107 0 41
> cclcgceli01.in2p3.fr:2119/jobmanager-bqs-T
> 89 0 23 66 23
> cclcgceli02.in2p3.fr:2119/jobmanager-bqs-A
> 67 66 0 0 0
> cclcgceli02.in2p3.fr:2119/jobmanager-bqs-G
> 530 20 489 0 0
> cclcgceli02.in2p3.fr:2119/jobmanager-bqs-T
> 530 5 489 489 0
> ce001.imbm.bas.bg:2119/jobmanager-pbs-short
> 56 14 2 7 0
> mu6.matrix.sara.nl:2119/jobmanager-pbs-cms
> 56 5 0 0 0
> ce001.imbm.bas.bg:2119/jobmanager-pbs-medium
> 5 40 0 0 0
> gate.grid.kiae.ru:2119/jobmanager-lcgpbs-long
> 101 81 26 0 0
> i101.hpc2n.umu.se:2119/jobmanager-torque-ngrid
> 180 164 0 0 0
> lxn1184.cern.ch:2119/jobmanager-lcglsf-grid
> 8 5 0 0 0
> ce001.grid.bas.bg:2119/jobmanager-torque-cms
> 8 40 0 0 0
> gate.grid.kiae.ru:2119/jobmanager-lcgpbs-short
> 8 5 0 0 0
> ce001.imbm.bas.bg:2119/jobmanager-pbs-infinite
> 7 3 25 0 0
> lcg02.ciemat.es:2119/jobmanager-lcgpbs-long
> 26 19 0 0 0
> gridce.pi.infn.it:2119/jobmanager-lcgpbs-long
> 7 3 312 0 0
> lcg02.ciemat.es:2119/jobmanager-lcgpbs-short
> 117 1 0 0 0
> ce.keldysh.ru:2119/jobmanager-lcgpbs-long
> 18 12 0 0 0
> ce1.egee.fr.cgg.com:2119/jobmanager-lcgpbs-long
> 40 20 10 0 0
> ceitep.itep.ru:2119/jobmanager-lcgpbs-cms
> 40 40 10 10 0
> gate.grid.kiae.ru:2119/jobmanager-lcgpbs-infinite
> 26 19 0 0 0
> gridce.pi.infn.it:2119/jobmanager-lcgpbs-short
> 158 24 11 1 0
> t2-ce-01.lnl.infn.it:2119/jobmanager-lcglsf-cms
> 158 1 11 11 0
> ce.keldysh.ru:2119/jobmanager-lcgpbs-short
> 18 12 0 0 0
> ce1.egee.fr.cgg.com:2119/jobmanager-lcgpbs-short
> 14 0 0 0 0
> grid0.fe.infn.it:2119/jobmanager-lcgpbs-long
> 115 17 1 40 0
> ce001.m45.ihep.su:2119/jobmanager-pbs-cms
> 18 12 6 1 0
> ce1.egee.fr.cgg.com:2119/jobmanager-lcgpbs-medium
> 14 0 0 0 0
> grid0.fe.infn.it:2119/jobmanager-lcgpbs-short
> 7 3 2 0 0
> lcg02.ciemat.es:2119/jobmanager-lcgpbs-infinite
> 24 12 0 0 0
> cmsboce1.bo.infn.it:2119/jobmanager-lcglsf-long
> 26 19 7 0 0
> gridce.pi.infn.it:2119/jobmanager-lcgpbs-infinite
> 26 25 7 7 0
> lcg2ce.tifrgrid.res.in:2119/jobmanager-lcgpbs-long
> 8 5 0 0 0
> node001.grid.auth.gr:2119/jobmanager-lcgpbs-long
> 10 7 3 0 0
> boalice5.bo.infn.it:2119/jobmanager-lcgpbs-long
> 24 12 8 0 0
> cmsboce1.bo.infn.it:2119/jobmanager-lcglsf-short
> 16 0 4 1 0
> grid002.ca.infn.it:2119/jobmanager-lcgpbs-long
> 8 25 5 3 2
> lcg2ce.tifrgrid.res.in:2119/jobmanager-lcgpbs-short
> 26 5 0 0 0
> node001.grid.auth.gr:2119/jobmanager-lcgpbs-short
> 10 7 0 0 0
> boalice5.bo.infn.it:2119/jobmanager-lcgpbs-short
> 115 17 2 0 2
> ce001.m45.ihep.su:2119/jobmanager-pbs-medium
> 14 0 14 0 0
> grid0.fe.infn.it:2119/jobmanager-lcgpbs-infinite
> 16 0 0 14 0
> grid002.ca.infn.it:2119/jobmanager-lcgpbs-short
> 8 0 28 0 28
> grid003.roma2.infn.it:2119/jobmanager-lcgpbs-short
> 64 64 0 0 0
> ce01.isabella.grnet.gr:2119/jobmanager-torque-short
> 24 12 5 0 0
> cmsboce1.bo.infn.it:2119/jobmanager-lcglsf-infinite
> 24 25 5 5 0
> lcg2ce.tifrgrid.res.in:2119/jobmanager-lcgpbs-infinite
> 26 5 0 0 0
> node001.grid.auth.gr:2119/jobmanager-lcgpbs-infinite
> 10 7 0 0 0
> boalice5.bo.infn.it:2119/jobmanager-lcgpbs-infinite
> 16 0 14 0 3
> grid002.ca.infn.it:2119/jobmanager-lcgpbs-infinite
> 8 51 10 5 5
> grid109.kfki.hu:2119/jobmanager-lcgcondor-budapest1
> 86 2 16 16 0
> hudson.datagrid.jussieu.fr:2119/jobmanager-lcgpbs-long
> 30 27 0 0 0
> lcg06.sinp.msu.ru:2119/jobmanager-torque-cms
> 66 29 0 0 0
> t2-ce-01.mi.infn.it:2119/jobmanager-lcgpbs-long
> 152 2 0 0 0
> hudson.datagrid.jussieu.fr:2119/jobmanager-lcgpbs-short
> 66 29 0 0 0
> t2-ce-01.mi.infn.it:2119/jobmanager-lcgpbs-short
> 832 358 0 0 0
> wn-04-07-01-a.cr.cnaf.infn.it:2119/jobmanager-lcgpbs-cdf
> 12 12 0 0 0
> atlasce01.na.infn.it:2119/jobmanager-lcgpbs-long
> 3 3 0 0 0
> ce01.novsu.ac.ru:2119/jobmanager-torque-cms
> 3 130 0 0 0
> lcg00125.grid.sinica.edu.tw:2119/jobmanager-lcgpbs-long
> 26 26 0 0 0
> marseillece01.mrs.grid.cnrs.fr:2119/jobmanager-pbs-lhcb
> 832 12 5 5 0
> atlasce01.na.infn.it:2119/jobmanager-lcgpbs-short
> 3 130 0 0 0
> lcg00125.grid.sinica.edu.tw:2119/jobmanager-lcgpbs-short
> 3 16 0 0 0
> helmsley.dur.scotgrid.ac.uk:2119/jobmanager-lcgpbs-long
> 16 2 0 0 0
> hudson.datagrid.jussieu.fr:2119/jobmanager-lcgpbs-infinite
> 66 29 14 0 0
> t2-ce-01.mi.infn.it:2119/jobmanager-lcgpbs-infinite
> 3 3 0 14 0
> ekp-lcg-ce.physik.uni-karlsruhe.de:2119/jobmanager-torque-cms
> 152 16 7 2 5
> helmsley.dur.scotgrid.ac.uk:2119/jobmanager-lcgpbs-short
> 66 12 15 15 0
> atlasce01.na.infn.it:2119/jobmanager-lcgpbs-infinite
> 3 130 0 0 0
> lcg00125.grid.sinica.edu.tw:2119/jobmanager-lcgpbs-infinite
> 3 2 0 0 0
> node2.egee.man.poznan.pl:2119/jobmanager-lcgpbs-long
> 152 16 5 5 0
> helmsley.dur.scotgrid.ac.uk:2119/jobmanager-lcgpbs-infinite
> 16 2 0 0 0
> node2.egee.man.poznan.pl:2119/jobmanager-lcgpbs-short
> 4 4 0 0 0
> accip43.physik.rwth-aachen.de:2119/jobmanager-torque-cms
> 4 2 1 1 0
> node2.egee.man.poznan.pl:2119/jobmanager-lcgpbs-infinite
>
> real 0m1.101s
> user 0m0.410s
> sys 0m0.100s
>
>
> It means 6 seconds for the option se and 1 second for the
> option ce. Using
> the atlas bdii in production. And the se option takes a bit
> more because
> it makes cross queries but a direct query (option ce) takes
> me 1 second.
>
>
> Cheers,
>
> Patricia
>
>
> On Mon, 14 Feb 2005, Burke, S (Stephen) wrote:
>
> > LHC Computer Grid - Rollout
> > > [mailto:[log in to unmask]] On Behalf Of Patricia
> > > Mendez Lorenzo said:
> > > If you want to retrieve the name of the SEs together with the
> > > available
> > > space and the type of SE you have to do a cross query because
> > > this info
> > > belongs to different entries while just making:
> > > "lcg-infosites --vo cms se" You will have in just some seconds:
> >
> > Well, this:
> >
> > time ldapsearch -x -h lcgbdii02.gridpp.rl.ac.uk -p 2170 -b o=grid
> > '(objectclass=gluese)' GlueSEName GlueSEUniqueID
> >
> > plus this:
> >
> > time ldapsearch -x -h lcgbdii02.gridpp.rl.ac.uk -p 2170 -b o=grid
> > '(&(objectclass=gluesa)(GlueSAAccessControlBaseRule=cms))'
> > GlueSAStateAvailableSpace GlueSAStateUsedSpace GlueChunkKey
> >
> > takes well under a second, and it seems unlikely that a bit
> of perl to
> > reformat the output would take that much longer ...
> >
> > Stephen
> >
>
> --
>
> EUROPEAN LABORATORY FOR PARTICLE PHYSICS -- CERN
> Patricia Mendez Lorenzo
> IT/GD Division
> Building: 28 Office: R-019
> Phone: +41 22 767 1925
> Fax: +41 22 767 7155
> Email: [log in to unmask]
>
|