 |
 |
On Mon, Feb 14, 2005 at 05:37:38PM +0100 or thereabouts, Ron Trompert wrote: > Hi Patricia and Stephen, > > When I do an ldapsearch on our own bdii mu3.matrix.sara.nl and > lcgbdii02.gridpp.rl.ac.uk I get: > > [ron@mu7 ron]$ time ldapsearch -x -h mu3.matrix.sara.nl -b > "mds-vo-name=local,o=grid" -p 2170 >/tmp/pipo > > real 0m1.195s > user 0m0.720s > sys 0m0.070s > [ron@mu7 ron]$ lcgbdii02.gridpp.rl.ac.uk > [ron@mu7 ron]$ time ldapsearch -x -h lcgbdii02.gridpp.rl.ac.uk -b > "mds-vo-name=local,o=grid" -p 2170 >/tmp/pipo2 > > real 0m0.979s > user 0m0.680s > sys 0m0.000s > > Which is rather similar and both bdii's contain almost the same amount > of information. However, when I do the following lcg-infosites commands > I get: > > [ron@mu7 ron]$ time /opt/lcg/bin/lcg-infosites --vo cms se --is > mu3.matrix.sara.nl:2170 >/tmp/pipo > > real 1m37.624s > user 0m1.850s > sys 0m0.500s > > [ron@mu7 ron]$ time /opt/lcg/bin/lcg-infosites --vo cms se --is > lcgbdii02.gridpp.rl.ac.uk:2170 >/tmp/pipo2 > > real 0m10.473s > user 0m1.860s > sys 0m0.420s > > This is quite a difference. However, it appears that the difference is > caused by diffences in response times of the bdii's: > > [ron@mu7 ron]$ time ldapsearch -LLL -x -h lcgbdii02.gridpp.rl.ac.uk:2170 > -p 2170 -b o=grid > '(&(ObjectClass=GlueSLTop)(GlueForeignKey=GlueSEUniqueID=lxfs04.jinr.ru) > )' GlueSLArchitectureType > dn: > GlueSLUniqueID=lxfs04.jinr.ru,Mds-Vo-name=rujinrlcg2,mds-vo-name=local,o > =g > rid > GlueSLArchitectureType: disk > > > real 0m0.099s > user 0m0.020s > sys 0m0.000s > [ron@mu7 ron]$ time ldapsearch -LLL -x -h mu3.matrix.sara.nl:2170 -p > 2170 -b o=grid > '(&(ObjectClass=GlueSLTop)(GlueForeignKey=GlueSEUniqueID=lxfs04.jinr.ru) > )' GlueSLArchitectureType > dn: > GlueSLUniqueID=lxfs04.jinr.ru,Mds-Vo-name=rujinrlcg2,mds-vo-name=local,o > =g > rid > GlueSLArchitectureType: disk > > > real 0m0.722s > user 0m0.020s > sys 0m0.000s > > The only question now is, why is mu3.matrix.sara.nl:2170 so slow? It's a > 3 GHz dual XEON machine with 2 GB of memory running both the RB and the > BDII. Any ideas? The BDII here is dual 2.6 XEON with 2GB, it is only doing this, it is only a BDII. Steve > > Cheers, > > Ron > <[log in to unmask]> > > > -----Original Message----- > > From: LHC Computer Grid - Rollout > > [mailto:[log in to unmask]] On Behalf Of Patricia > > Mendez Lorenzo > > Sent: maandag 14 februari 2005 14:24 > > To: [log in to unmask] > > Subject: Re: [LCG-ROLLOUT] lcg-infosites takes forever to complete > > > > Hello, > > > > I get these results: > > > > time /opt/lcg/bin/lcg-infosites --vo cms se --is atlas-bdii > > > > ************************************************************** > > These are the related data for cms: (in terms of SE) > > ************************************************************** > > > > Avail Space(Kb) Used Space(Kb) Type SEs > > ---------------------------------------------------------- > > 69501256, 3514180 disk se01.lip.pt > > 231010476 337690452 disk teras.sara.nl > > 1000000000000 500000000000 mss lcgse03.ifae.es > > 1000000000000 500000000000 mss lcgse05.ifae.es > > 364974260 80808 disk cms10.fuw.edu.pl > > 32633372 3344388 disk se001.imbm.bas.bg > > 1000000000000 500000000000 mss castorgrid.ifae.es > > 13415712 59042920 disk lcg03.ciemat.es > > 60968612 10049540 disk se001.grid.bas.bg > > 1000000000000 500000000000 mss castorgrid.cern.ch > > 152149224 704811416 disk mu2.matrix.sara.nl > > 115173368 670027744 disk grid001.pi.infn.it > > 1454113344 6087780 disk grid100.kfki.hu > > 65897344 6584184 disk se.keldysh.ru > > 46650528 3150492 disk se1.egee.fr.cgg.com > > 1829656844 317167348 disk cclcgseli01.in2p3.fr > > 999999999 0 disk cclcgseli02.in2p3.fr > > 2504416 24364820 disk grid2.fe.infn.it > > 976083880 4242904 disk ibelieve-i.hpc2n.umu.se > > 945372284 9813452 disk seitep.itep.ru > > 206710740 1240906608 disk t2-se-02.lnl.infn.it > > 51426744 4146200 disk castorftp.cnaf.infn.it > > 286518768 610893064 disk cmsbose1.bo.infn.it > > 1338045984 494064932 disk cmsbose2.bo.infn.it > > 34199084 1778676 disk lcg2se.tifrgrid.res.in > > 226574596 1578260 disk node004.grid.auth.gr > > 65100172 9677308 disk boalice1.bo.infn.it > > 102463172 9179908 disk grid003.ca.infn.it > > 1000000000000 500000000000 mss castorsrm.cr.cnaf.infn.it > > 1587581516 37332792 disk se001.m45.ihep.su > > 3421942528 6446336 disk se01.isabella.grnet.gr > > 1227081176 920246312 disk zeus03.cyf-kr.edu.pl > > 1000000000000 500000000000 mss castorgrid.cr.cnaf.infn.it > > 231361796 1371738752 disk grid002.mi.infn.it > > 106145864 2839384 rfio castor.grid.sinica.edu.tw > > 10000000000 5000000000 disk castorftp-1.cr.cnaf.infn.it > > 1470757032 132343516 disk t2-se-01.mi.infn.it > > 356800640 100033184 disk barentz.datagrid.jussieu.fr > > 190138312 101919952 disk lcg13.sinp.msu.ru > > 10000000000 5000000000 disk castorftp-cms.cr.cnaf.infn.it > > 1264056948 693542992 disk lcg00123.grid.sinica.edu.tw > > n.a n.a disk diskserv-cms-2.cr.cnaf.infn.it > > 107789824 7852288512 disk diskserv-lhc-2.cr.cnaf.infn.it > > 1915261116 713044 disk gallows.dur.scotgrid.ac.uk > > 357218844 555382860 disk griditse01.na.infn.it > > 58022352 13992228 disk se01.novsu.ac.ru > > 29641836 3798876 disk serv02.hep.phy.cam.ac.uk > > 223369508 35881252 disk > > ekp-lcg-se.physik.uni-karlsruhe.de > > 49232708 15834008 mss node1.egee.man.poznan.pl > > 1000000000000 500000000000 disk castorsrm.ifae.es > > 27929516 n.a mss accip41.physik.rwth-aachen.de > > 1000000000000 500000000000 disk castorsrm.cern.ch > > 721160000 61710000 se002.m45.ihep.su > > > > real 0m6.335s > > user 0m2.520s > > sys 0m0.890s > > > > > > And > > > > time /opt/lcg/bin/lcg-infosites --vo cms ce --is atlas-bdii > > > > > > **************************************************************** > > These are the related data for cms: (in terms of queues and CPUs) > > **************************************************************** > > > > #CPU Free Total Jobs Running Waiting ComputingElement > > ---------------------------------------------------------- > > 8 8 0 2 0 > > ce01.lip.pt:2119/jobmanager-torque-cms > > 8 5 0 0 0 > > ce001.imbm.bas.bg:2119/jobmanager-pbs-long > > 180 22 18 0 0 > > lcgce02.ifae.es:2119/jobmanager-lcgpbs-cms > > 57 0 40 18 40 > > cclcgceli01.in2p3.fr:2119/jobmanager-bqs-A > > 57 55 0 0 0 > > cclcgceli01.in2p3.fr:2119/jobmanager-bqs-G > > 93 0 107 0 41 > > cclcgceli01.in2p3.fr:2119/jobmanager-bqs-T > > 89 0 23 66 23 > > cclcgceli02.in2p3.fr:2119/jobmanager-bqs-A > > 67 66 0 0 0 > > cclcgceli02.in2p3.fr:2119/jobmanager-bqs-G > > 530 20 489 0 0 > > cclcgceli02.in2p3.fr:2119/jobmanager-bqs-T > > 530 5 489 489 0 > > ce001.imbm.bas.bg:2119/jobmanager-pbs-short > > 56 14 2 7 0 > > mu6.matrix.sara.nl:2119/jobmanager-pbs-cms > > 56 5 0 0 0 > > ce001.imbm.bas.bg:2119/jobmanager-pbs-medium > > 5 40 0 0 0 > > gate.grid.kiae.ru:2119/jobmanager-lcgpbs-long > > 101 81 26 0 0 > > i101.hpc2n.umu.se:2119/jobmanager-torque-ngrid > > 180 164 0 0 0 > > lxn1184.cern.ch:2119/jobmanager-lcglsf-grid > > 8 5 0 0 0 > > ce001.grid.bas.bg:2119/jobmanager-torque-cms > > 8 40 0 0 0 > > gate.grid.kiae.ru:2119/jobmanager-lcgpbs-short > > 8 5 0 0 0 > > ce001.imbm.bas.bg:2119/jobmanager-pbs-infinite > > 7 3 25 0 0 > > lcg02.ciemat.es:2119/jobmanager-lcgpbs-long > > 26 19 0 0 0 > > gridce.pi.infn.it:2119/jobmanager-lcgpbs-long > > 7 3 312 0 0 > > lcg02.ciemat.es:2119/jobmanager-lcgpbs-short > > 117 1 0 0 0 > > ce.keldysh.ru:2119/jobmanager-lcgpbs-long > > 18 12 0 0 0 > > ce1.egee.fr.cgg.com:2119/jobmanager-lcgpbs-long > > 40 20 10 0 0 > > ceitep.itep.ru:2119/jobmanager-lcgpbs-cms > > 40 40 10 10 0 > > gate.grid.kiae.ru:2119/jobmanager-lcgpbs-infinite > > 26 19 0 0 0 > > gridce.pi.infn.it:2119/jobmanager-lcgpbs-short > > 158 24 11 1 0 > > t2-ce-01.lnl.infn.it:2119/jobmanager-lcglsf-cms > > 158 1 11 11 0 > > ce.keldysh.ru:2119/jobmanager-lcgpbs-short > > 18 12 0 0 0 > > ce1.egee.fr.cgg.com:2119/jobmanager-lcgpbs-short > > 14 0 0 0 0 > > grid0.fe.infn.it:2119/jobmanager-lcgpbs-long > > 115 17 1 40 0 > > ce001.m45.ihep.su:2119/jobmanager-pbs-cms > > 18 12 6 1 0 > > ce1.egee.fr.cgg.com:2119/jobmanager-lcgpbs-medium > > 14 0 0 0 0 > > grid0.fe.infn.it:2119/jobmanager-lcgpbs-short > > 7 3 2 0 0 > > lcg02.ciemat.es:2119/jobmanager-lcgpbs-infinite > > 24 12 0 0 0 > > cmsboce1.bo.infn.it:2119/jobmanager-lcglsf-long > > 26 19 7 0 0 > > gridce.pi.infn.it:2119/jobmanager-lcgpbs-infinite > > 26 25 7 7 0 > > lcg2ce.tifrgrid.res.in:2119/jobmanager-lcgpbs-long > > 8 5 0 0 0 > > node001.grid.auth.gr:2119/jobmanager-lcgpbs-long > > 10 7 3 0 0 > > boalice5.bo.infn.it:2119/jobmanager-lcgpbs-long > > 24 12 8 0 0 > > cmsboce1.bo.infn.it:2119/jobmanager-lcglsf-short > > 16 0 4 1 0 > > grid002.ca.infn.it:2119/jobmanager-lcgpbs-long > > 8 25 5 3 2 > > lcg2ce.tifrgrid.res.in:2119/jobmanager-lcgpbs-short > > 26 5 0 0 0 > > node001.grid.auth.gr:2119/jobmanager-lcgpbs-short > > 10 7 0 0 0 > > boalice5.bo.infn.it:2119/jobmanager-lcgpbs-short > > 115 17 2 0 2 > > ce001.m45.ihep.su:2119/jobmanager-pbs-medium > > 14 0 14 0 0 > > grid0.fe.infn.it:2119/jobmanager-lcgpbs-infinite > > 16 0 0 14 0 > > grid002.ca.infn.it:2119/jobmanager-lcgpbs-short > > 8 0 28 0 28 > > grid003.roma2.infn.it:2119/jobmanager-lcgpbs-short > > 64 64 0 0 0 > > ce01.isabella.grnet.gr:2119/jobmanager-torque-short > > 24 12 5 0 0 > > cmsboce1.bo.infn.it:2119/jobmanager-lcglsf-infinite > > 24 25 5 5 0 > > lcg2ce.tifrgrid.res.in:2119/jobmanager-lcgpbs-infinite > > 26 5 0 0 0 > > node001.grid.auth.gr:2119/jobmanager-lcgpbs-infinite > > 10 7 0 0 0 > > boalice5.bo.infn.it:2119/jobmanager-lcgpbs-infinite > > 16 0 14 0 3 > > grid002.ca.infn.it:2119/jobmanager-lcgpbs-infinite > > 8 51 10 5 5 > > grid109.kfki.hu:2119/jobmanager-lcgcondor-budapest1 > > 86 2 16 16 0 > > hudson.datagrid.jussieu.fr:2119/jobmanager-lcgpbs-long > > 30 27 0 0 0 > > lcg06.sinp.msu.ru:2119/jobmanager-torque-cms > > 66 29 0 0 0 > > t2-ce-01.mi.infn.it:2119/jobmanager-lcgpbs-long > > 152 2 0 0 0 > > hudson.datagrid.jussieu.fr:2119/jobmanager-lcgpbs-short > > 66 29 0 0 0 > > t2-ce-01.mi.infn.it:2119/jobmanager-lcgpbs-short > > 832 358 0 0 0 > > wn-04-07-01-a.cr.cnaf.infn.it:2119/jobmanager-lcgpbs-cdf > > 12 12 0 0 0 > > atlasce01.na.infn.it:2119/jobmanager-lcgpbs-long > > 3 3 0 0 0 > > ce01.novsu.ac.ru:2119/jobmanager-torque-cms > > 3 130 0 0 0 > > lcg00125.grid.sinica.edu.tw:2119/jobmanager-lcgpbs-long > > 26 26 0 0 0 > > marseillece01.mrs.grid.cnrs.fr:2119/jobmanager-pbs-lhcb > > 832 12 5 5 0 > > atlasce01.na.infn.it:2119/jobmanager-lcgpbs-short > > 3 130 0 0 0 > > lcg00125.grid.sinica.edu.tw:2119/jobmanager-lcgpbs-short > > 3 16 0 0 0 > > helmsley.dur.scotgrid.ac.uk:2119/jobmanager-lcgpbs-long > > 16 2 0 0 0 > > hudson.datagrid.jussieu.fr:2119/jobmanager-lcgpbs-infinite > > 66 29 14 0 0 > > t2-ce-01.mi.infn.it:2119/jobmanager-lcgpbs-infinite > > 3 3 0 14 0 > > ekp-lcg-ce.physik.uni-karlsruhe.de:2119/jobmanager-torque-cms > > 152 16 7 2 5 > > helmsley.dur.scotgrid.ac.uk:2119/jobmanager-lcgpbs-short > > 66 12 15 15 0 > > atlasce01.na.infn.it:2119/jobmanager-lcgpbs-infinite > > 3 130 0 0 0 > > lcg00125.grid.sinica.edu.tw:2119/jobmanager-lcgpbs-infinite > > 3 2 0 0 0 > > node2.egee.man.poznan.pl:2119/jobmanager-lcgpbs-long > > 152 16 5 5 0 > > helmsley.dur.scotgrid.ac.uk:2119/jobmanager-lcgpbs-infinite > > 16 2 0 0 0 > > node2.egee.man.poznan.pl:2119/jobmanager-lcgpbs-short > > 4 4 0 0 0 > > accip43.physik.rwth-aachen.de:2119/jobmanager-torque-cms > > 4 2 1 1 0 > > node2.egee.man.poznan.pl:2119/jobmanager-lcgpbs-infinite > > > > real 0m1.101s > > user 0m0.410s > > sys 0m0.100s > > > > > > It means 6 seconds for the option se and 1 second for the > > option ce. Using > > the atlas bdii in production. And the se option takes a bit > > more because > > it makes cross queries but a direct query (option ce) takes > > me 1 second. > > > > > > Cheers, > > > > Patricia > > > > > > On Mon, 14 Feb 2005, Burke, S (Stephen) wrote: > > > > > LHC Computer Grid - Rollout > > > > [mailto:[log in to unmask]] On Behalf Of Patricia > > > > Mendez Lorenzo said: > > > > If you want to retrieve the name of the SEs together with the > > > > available > > > > space and the type of SE you have to do a cross query because > > > > this info > > > > belongs to different entries while just making: > > > > "lcg-infosites --vo cms se" You will have in just some seconds: > > > > > > Well, this: > > > > > > time ldapsearch -x -h lcgbdii02.gridpp.rl.ac.uk -p 2170 -b o=grid > > > '(objectclass=gluese)' GlueSEName GlueSEUniqueID > > > > > > plus this: > > > > > > time ldapsearch -x -h lcgbdii02.gridpp.rl.ac.uk -p 2170 -b o=grid > > > '(&(objectclass=gluesa)(GlueSAAccessControlBaseRule=cms))' > > > GlueSAStateAvailableSpace GlueSAStateUsedSpace GlueChunkKey > > > > > > takes well under a second, and it seems unlikely that a bit > > of perl to > > > reformat the output would take that much longer ... > > > > > > Stephen > > > > > > > -- > > > > EUROPEAN LABORATORY FOR PARTICLE PHYSICS -- CERN > > Patricia Mendez Lorenzo > > IT/GD Division > > Building: 28 Office: R-019 > > Phone: +41 22 767 1925 > > Fax: +41 22 767 7155 > > Email: [log in to unmask] > > -- Steve Traylen [log in to unmask] http://www.gridpp.ac.uk/