On Mon, Feb 14, 2005 at 05:37:38PM +0100 or thereabouts, Ron Trompert wrote:
> Hi Patricia and Stephen,
>
> When I do an ldapsearch on our own bdii mu3.matrix.sara.nl and
> lcgbdii02.gridpp.rl.ac.uk I get:
>
> [ron@mu7 ron]$ time ldapsearch -x -h mu3.matrix.sara.nl -b
> "mds-vo-name=local,o=grid" -p 2170 >/tmp/pipo
>
> real 0m1.195s
> user 0m0.720s
> sys 0m0.070s
> [ron@mu7 ron]$ lcgbdii02.gridpp.rl.ac.uk
> [ron@mu7 ron]$ time ldapsearch -x -h lcgbdii02.gridpp.rl.ac.uk -b
> "mds-vo-name=local,o=grid" -p 2170 >/tmp/pipo2
>
> real 0m0.979s
> user 0m0.680s
> sys 0m0.000s
>
> Which is rather similar and both bdii's contain almost the same amount
> of information. However, when I do the following lcg-infosites commands
> I get:
>
> [ron@mu7 ron]$ time /opt/lcg/bin/lcg-infosites --vo cms se --is
> mu3.matrix.sara.nl:2170 >/tmp/pipo
>
> real 1m37.624s
> user 0m1.850s
> sys 0m0.500s
>
> [ron@mu7 ron]$ time /opt/lcg/bin/lcg-infosites --vo cms se --is
> lcgbdii02.gridpp.rl.ac.uk:2170 >/tmp/pipo2
>
> real 0m10.473s
> user 0m1.860s
> sys 0m0.420s
>
> This is quite a difference. However, it appears that the difference is
> caused by diffences in response times of the bdii's:
>
> [ron@mu7 ron]$ time ldapsearch -LLL -x -h lcgbdii02.gridpp.rl.ac.uk:2170
> -p 2170 -b o=grid
> '(&(ObjectClass=GlueSLTop)(GlueForeignKey=GlueSEUniqueID=lxfs04.jinr.ru)
> )' GlueSLArchitectureType
> dn:
> GlueSLUniqueID=lxfs04.jinr.ru,Mds-Vo-name=rujinrlcg2,mds-vo-name=local,o
> =g
> rid
> GlueSLArchitectureType: disk
>
>
> real 0m0.099s
> user 0m0.020s
> sys 0m0.000s
> [ron@mu7 ron]$ time ldapsearch -LLL -x -h mu3.matrix.sara.nl:2170 -p
> 2170 -b o=grid
> '(&(ObjectClass=GlueSLTop)(GlueForeignKey=GlueSEUniqueID=lxfs04.jinr.ru)
> )' GlueSLArchitectureType
> dn:
> GlueSLUniqueID=lxfs04.jinr.ru,Mds-Vo-name=rujinrlcg2,mds-vo-name=local,o
> =g
> rid
> GlueSLArchitectureType: disk
>
>
> real 0m0.722s
> user 0m0.020s
> sys 0m0.000s
>
> The only question now is, why is mu3.matrix.sara.nl:2170 so slow? It's a
> 3 GHz dual XEON machine with 2 GB of memory running both the RB and the
> BDII. Any ideas?
The BDII here is dual 2.6 XEON with 2GB, it is only doing this, it is
only a BDII.
Steve
>
> Cheers,
>
> Ron
> <[log in to unmask]>
>
> > -----Original Message-----
> > From: LHC Computer Grid - Rollout
> > [mailto:[log in to unmask]] On Behalf Of Patricia
> > Mendez Lorenzo
> > Sent: maandag 14 februari 2005 14:24
> > To: [log in to unmask]
> > Subject: Re: [LCG-ROLLOUT] lcg-infosites takes forever to complete
> >
> > Hello,
> >
> > I get these results:
> >
> > time /opt/lcg/bin/lcg-infosites --vo cms se --is atlas-bdii
> >
> > **************************************************************
> > These are the related data for cms: (in terms of SE)
> > **************************************************************
> >
> > Avail Space(Kb) Used Space(Kb) Type SEs
> > ----------------------------------------------------------
> > 69501256, 3514180 disk se01.lip.pt
> > 231010476 337690452 disk teras.sara.nl
> > 1000000000000 500000000000 mss lcgse03.ifae.es
> > 1000000000000 500000000000 mss lcgse05.ifae.es
> > 364974260 80808 disk cms10.fuw.edu.pl
> > 32633372 3344388 disk se001.imbm.bas.bg
> > 1000000000000 500000000000 mss castorgrid.ifae.es
> > 13415712 59042920 disk lcg03.ciemat.es
> > 60968612 10049540 disk se001.grid.bas.bg
> > 1000000000000 500000000000 mss castorgrid.cern.ch
> > 152149224 704811416 disk mu2.matrix.sara.nl
> > 115173368 670027744 disk grid001.pi.infn.it
> > 1454113344 6087780 disk grid100.kfki.hu
> > 65897344 6584184 disk se.keldysh.ru
> > 46650528 3150492 disk se1.egee.fr.cgg.com
> > 1829656844 317167348 disk cclcgseli01.in2p3.fr
> > 999999999 0 disk cclcgseli02.in2p3.fr
> > 2504416 24364820 disk grid2.fe.infn.it
> > 976083880 4242904 disk ibelieve-i.hpc2n.umu.se
> > 945372284 9813452 disk seitep.itep.ru
> > 206710740 1240906608 disk t2-se-02.lnl.infn.it
> > 51426744 4146200 disk castorftp.cnaf.infn.it
> > 286518768 610893064 disk cmsbose1.bo.infn.it
> > 1338045984 494064932 disk cmsbose2.bo.infn.it
> > 34199084 1778676 disk lcg2se.tifrgrid.res.in
> > 226574596 1578260 disk node004.grid.auth.gr
> > 65100172 9677308 disk boalice1.bo.infn.it
> > 102463172 9179908 disk grid003.ca.infn.it
> > 1000000000000 500000000000 mss castorsrm.cr.cnaf.infn.it
> > 1587581516 37332792 disk se001.m45.ihep.su
> > 3421942528 6446336 disk se01.isabella.grnet.gr
> > 1227081176 920246312 disk zeus03.cyf-kr.edu.pl
> > 1000000000000 500000000000 mss castorgrid.cr.cnaf.infn.it
> > 231361796 1371738752 disk grid002.mi.infn.it
> > 106145864 2839384 rfio castor.grid.sinica.edu.tw
> > 10000000000 5000000000 disk castorftp-1.cr.cnaf.infn.it
> > 1470757032 132343516 disk t2-se-01.mi.infn.it
> > 356800640 100033184 disk barentz.datagrid.jussieu.fr
> > 190138312 101919952 disk lcg13.sinp.msu.ru
> > 10000000000 5000000000 disk castorftp-cms.cr.cnaf.infn.it
> > 1264056948 693542992 disk lcg00123.grid.sinica.edu.tw
> > n.a n.a disk diskserv-cms-2.cr.cnaf.infn.it
> > 107789824 7852288512 disk diskserv-lhc-2.cr.cnaf.infn.it
> > 1915261116 713044 disk gallows.dur.scotgrid.ac.uk
> > 357218844 555382860 disk griditse01.na.infn.it
> > 58022352 13992228 disk se01.novsu.ac.ru
> > 29641836 3798876 disk serv02.hep.phy.cam.ac.uk
> > 223369508 35881252 disk
> > ekp-lcg-se.physik.uni-karlsruhe.de
> > 49232708 15834008 mss node1.egee.man.poznan.pl
> > 1000000000000 500000000000 disk castorsrm.ifae.es
> > 27929516 n.a mss accip41.physik.rwth-aachen.de
> > 1000000000000 500000000000 disk castorsrm.cern.ch
> > 721160000 61710000 se002.m45.ihep.su
> >
> > real 0m6.335s
> > user 0m2.520s
> > sys 0m0.890s
> >
> >
> > And
> >
> > time /opt/lcg/bin/lcg-infosites --vo cms ce --is atlas-bdii
> >
> >
> > ****************************************************************
> > These are the related data for cms: (in terms of queues and CPUs)
> > ****************************************************************
> >
> > #CPU Free Total Jobs Running Waiting ComputingElement
> > ----------------------------------------------------------
> > 8 8 0 2 0
> > ce01.lip.pt:2119/jobmanager-torque-cms
> > 8 5 0 0 0
> > ce001.imbm.bas.bg:2119/jobmanager-pbs-long
> > 180 22 18 0 0
> > lcgce02.ifae.es:2119/jobmanager-lcgpbs-cms
> > 57 0 40 18 40
> > cclcgceli01.in2p3.fr:2119/jobmanager-bqs-A
> > 57 55 0 0 0
> > cclcgceli01.in2p3.fr:2119/jobmanager-bqs-G
> > 93 0 107 0 41
> > cclcgceli01.in2p3.fr:2119/jobmanager-bqs-T
> > 89 0 23 66 23
> > cclcgceli02.in2p3.fr:2119/jobmanager-bqs-A
> > 67 66 0 0 0
> > cclcgceli02.in2p3.fr:2119/jobmanager-bqs-G
> > 530 20 489 0 0
> > cclcgceli02.in2p3.fr:2119/jobmanager-bqs-T
> > 530 5 489 489 0
> > ce001.imbm.bas.bg:2119/jobmanager-pbs-short
> > 56 14 2 7 0
> > mu6.matrix.sara.nl:2119/jobmanager-pbs-cms
> > 56 5 0 0 0
> > ce001.imbm.bas.bg:2119/jobmanager-pbs-medium
> > 5 40 0 0 0
> > gate.grid.kiae.ru:2119/jobmanager-lcgpbs-long
> > 101 81 26 0 0
> > i101.hpc2n.umu.se:2119/jobmanager-torque-ngrid
> > 180 164 0 0 0
> > lxn1184.cern.ch:2119/jobmanager-lcglsf-grid
> > 8 5 0 0 0
> > ce001.grid.bas.bg:2119/jobmanager-torque-cms
> > 8 40 0 0 0
> > gate.grid.kiae.ru:2119/jobmanager-lcgpbs-short
> > 8 5 0 0 0
> > ce001.imbm.bas.bg:2119/jobmanager-pbs-infinite
> > 7 3 25 0 0
> > lcg02.ciemat.es:2119/jobmanager-lcgpbs-long
> > 26 19 0 0 0
> > gridce.pi.infn.it:2119/jobmanager-lcgpbs-long
> > 7 3 312 0 0
> > lcg02.ciemat.es:2119/jobmanager-lcgpbs-short
> > 117 1 0 0 0
> > ce.keldysh.ru:2119/jobmanager-lcgpbs-long
> > 18 12 0 0 0
> > ce1.egee.fr.cgg.com:2119/jobmanager-lcgpbs-long
> > 40 20 10 0 0
> > ceitep.itep.ru:2119/jobmanager-lcgpbs-cms
> > 40 40 10 10 0
> > gate.grid.kiae.ru:2119/jobmanager-lcgpbs-infinite
> > 26 19 0 0 0
> > gridce.pi.infn.it:2119/jobmanager-lcgpbs-short
> > 158 24 11 1 0
> > t2-ce-01.lnl.infn.it:2119/jobmanager-lcglsf-cms
> > 158 1 11 11 0
> > ce.keldysh.ru:2119/jobmanager-lcgpbs-short
> > 18 12 0 0 0
> > ce1.egee.fr.cgg.com:2119/jobmanager-lcgpbs-short
> > 14 0 0 0 0
> > grid0.fe.infn.it:2119/jobmanager-lcgpbs-long
> > 115 17 1 40 0
> > ce001.m45.ihep.su:2119/jobmanager-pbs-cms
> > 18 12 6 1 0
> > ce1.egee.fr.cgg.com:2119/jobmanager-lcgpbs-medium
> > 14 0 0 0 0
> > grid0.fe.infn.it:2119/jobmanager-lcgpbs-short
> > 7 3 2 0 0
> > lcg02.ciemat.es:2119/jobmanager-lcgpbs-infinite
> > 24 12 0 0 0
> > cmsboce1.bo.infn.it:2119/jobmanager-lcglsf-long
> > 26 19 7 0 0
> > gridce.pi.infn.it:2119/jobmanager-lcgpbs-infinite
> > 26 25 7 7 0
> > lcg2ce.tifrgrid.res.in:2119/jobmanager-lcgpbs-long
> > 8 5 0 0 0
> > node001.grid.auth.gr:2119/jobmanager-lcgpbs-long
> > 10 7 3 0 0
> > boalice5.bo.infn.it:2119/jobmanager-lcgpbs-long
> > 24 12 8 0 0
> > cmsboce1.bo.infn.it:2119/jobmanager-lcglsf-short
> > 16 0 4 1 0
> > grid002.ca.infn.it:2119/jobmanager-lcgpbs-long
> > 8 25 5 3 2
> > lcg2ce.tifrgrid.res.in:2119/jobmanager-lcgpbs-short
> > 26 5 0 0 0
> > node001.grid.auth.gr:2119/jobmanager-lcgpbs-short
> > 10 7 0 0 0
> > boalice5.bo.infn.it:2119/jobmanager-lcgpbs-short
> > 115 17 2 0 2
> > ce001.m45.ihep.su:2119/jobmanager-pbs-medium
> > 14 0 14 0 0
> > grid0.fe.infn.it:2119/jobmanager-lcgpbs-infinite
> > 16 0 0 14 0
> > grid002.ca.infn.it:2119/jobmanager-lcgpbs-short
> > 8 0 28 0 28
> > grid003.roma2.infn.it:2119/jobmanager-lcgpbs-short
> > 64 64 0 0 0
> > ce01.isabella.grnet.gr:2119/jobmanager-torque-short
> > 24 12 5 0 0
> > cmsboce1.bo.infn.it:2119/jobmanager-lcglsf-infinite
> > 24 25 5 5 0
> > lcg2ce.tifrgrid.res.in:2119/jobmanager-lcgpbs-infinite
> > 26 5 0 0 0
> > node001.grid.auth.gr:2119/jobmanager-lcgpbs-infinite
> > 10 7 0 0 0
> > boalice5.bo.infn.it:2119/jobmanager-lcgpbs-infinite
> > 16 0 14 0 3
> > grid002.ca.infn.it:2119/jobmanager-lcgpbs-infinite
> > 8 51 10 5 5
> > grid109.kfki.hu:2119/jobmanager-lcgcondor-budapest1
> > 86 2 16 16 0
> > hudson.datagrid.jussieu.fr:2119/jobmanager-lcgpbs-long
> > 30 27 0 0 0
> > lcg06.sinp.msu.ru:2119/jobmanager-torque-cms
> > 66 29 0 0 0
> > t2-ce-01.mi.infn.it:2119/jobmanager-lcgpbs-long
> > 152 2 0 0 0
> > hudson.datagrid.jussieu.fr:2119/jobmanager-lcgpbs-short
> > 66 29 0 0 0
> > t2-ce-01.mi.infn.it:2119/jobmanager-lcgpbs-short
> > 832 358 0 0 0
> > wn-04-07-01-a.cr.cnaf.infn.it:2119/jobmanager-lcgpbs-cdf
> > 12 12 0 0 0
> > atlasce01.na.infn.it:2119/jobmanager-lcgpbs-long
> > 3 3 0 0 0
> > ce01.novsu.ac.ru:2119/jobmanager-torque-cms
> > 3 130 0 0 0
> > lcg00125.grid.sinica.edu.tw:2119/jobmanager-lcgpbs-long
> > 26 26 0 0 0
> > marseillece01.mrs.grid.cnrs.fr:2119/jobmanager-pbs-lhcb
> > 832 12 5 5 0
> > atlasce01.na.infn.it:2119/jobmanager-lcgpbs-short
> > 3 130 0 0 0
> > lcg00125.grid.sinica.edu.tw:2119/jobmanager-lcgpbs-short
> > 3 16 0 0 0
> > helmsley.dur.scotgrid.ac.uk:2119/jobmanager-lcgpbs-long
> > 16 2 0 0 0
> > hudson.datagrid.jussieu.fr:2119/jobmanager-lcgpbs-infinite
> > 66 29 14 0 0
> > t2-ce-01.mi.infn.it:2119/jobmanager-lcgpbs-infinite
> > 3 3 0 14 0
> > ekp-lcg-ce.physik.uni-karlsruhe.de:2119/jobmanager-torque-cms
> > 152 16 7 2 5
> > helmsley.dur.scotgrid.ac.uk:2119/jobmanager-lcgpbs-short
> > 66 12 15 15 0
> > atlasce01.na.infn.it:2119/jobmanager-lcgpbs-infinite
> > 3 130 0 0 0
> > lcg00125.grid.sinica.edu.tw:2119/jobmanager-lcgpbs-infinite
> > 3 2 0 0 0
> > node2.egee.man.poznan.pl:2119/jobmanager-lcgpbs-long
> > 152 16 5 5 0
> > helmsley.dur.scotgrid.ac.uk:2119/jobmanager-lcgpbs-infinite
> > 16 2 0 0 0
> > node2.egee.man.poznan.pl:2119/jobmanager-lcgpbs-short
> > 4 4 0 0 0
> > accip43.physik.rwth-aachen.de:2119/jobmanager-torque-cms
> > 4 2 1 1 0
> > node2.egee.man.poznan.pl:2119/jobmanager-lcgpbs-infinite
> >
> > real 0m1.101s
> > user 0m0.410s
> > sys 0m0.100s
> >
> >
> > It means 6 seconds for the option se and 1 second for the
> > option ce. Using
> > the atlas bdii in production. And the se option takes a bit
> > more because
> > it makes cross queries but a direct query (option ce) takes
> > me 1 second.
> >
> >
> > Cheers,
> >
> > Patricia
> >
> >
> > On Mon, 14 Feb 2005, Burke, S (Stephen) wrote:
> >
> > > LHC Computer Grid - Rollout
> > > > [mailto:[log in to unmask]] On Behalf Of Patricia
> > > > Mendez Lorenzo said:
> > > > If you want to retrieve the name of the SEs together with the
> > > > available
> > > > space and the type of SE you have to do a cross query because
> > > > this info
> > > > belongs to different entries while just making:
> > > > "lcg-infosites --vo cms se" You will have in just some seconds:
> > >
> > > Well, this:
> > >
> > > time ldapsearch -x -h lcgbdii02.gridpp.rl.ac.uk -p 2170 -b o=grid
> > > '(objectclass=gluese)' GlueSEName GlueSEUniqueID
> > >
> > > plus this:
> > >
> > > time ldapsearch -x -h lcgbdii02.gridpp.rl.ac.uk -p 2170 -b o=grid
> > > '(&(objectclass=gluesa)(GlueSAAccessControlBaseRule=cms))'
> > > GlueSAStateAvailableSpace GlueSAStateUsedSpace GlueChunkKey
> > >
> > > takes well under a second, and it seems unlikely that a bit
> > of perl to
> > > reformat the output would take that much longer ...
> > >
> > > Stephen
> > >
> >
> > --
> >
> > EUROPEAN LABORATORY FOR PARTICLE PHYSICS -- CERN
> > Patricia Mendez Lorenzo
> > IT/GD Division
> > Building: 28 Office: R-019
> > Phone: +41 22 767 1925
> > Fax: +41 22 767 7155
> > Email: [log in to unmask]
> >
--
Steve Traylen
[log in to unmask]
http://www.gridpp.ac.uk/
|
