Greig, the gangarobot link Graeme sent shows job efficiency plots per
site.
> -----Original Message-----
> From: Testbed Support for GridPP member institutes [mailto:TB-
> [log in to unmask]] On Behalf Of Greig A. Cowan
> Sent: 25 November 2008 14:33
> To: [log in to unmask]
> Subject: Re: Analysis challenge in the UK tomorrow
>
> Hi Graeme,
>
> Do you have numbers for how CPU efficient these analysis jobs were? It
> will be interesting to see how IO-bound they were. You're using rfio,
> right?
>
> Putting things into a physics perspective, it would also be
interesting
> to know how many events were processed by each analysis job per unit
> time.
>
> Anyway, looks like it's been a good exercise so far and the DPM disk
> servers don't look all that loaded going by your ganglia.
>
> Cheers,
> Greig
>
> Graeme Stewart wrote, On 25/11/08 13:11:
> > Brian,
> >
> > Glasgow is here:
> >
> >
>
http://svr031.gla.scotgrid.ac.uk/ganglia/?c=DPM%20Storage&m=&r=hour&s=b
> y%20hostname&hc=4
> >
> > Preliminary results:
> >
> > "We had 40 jobs (just 40!) running on the
> > cluster before lunch sucking data out of our DPM at ~600MB/s, which
> is
> > 15MB/job (75Hz for 200kB AOD????).
> >
> > Currently we're running 85 jobs and hitting 1GB/s from our storage,
> > which is about the limit (9 servers x 1Gb).
> >
> > This means we have saturated our i/o capacity with a cluster which
is
> > 15% full of analysis jobs.
> >
> > I think we need more network cards and bigger switches. I am
> astonished.
> >
> > Graeme"
> >
> >
> > On Tue, Nov 25, 2008 at 9:37 AM, Davies, BGE (Brian)
> > <[log in to unmask]> wrote:
> >
> >> I have been collecting ganglia endpoints for those sites which
> publish
> >> so as to be able to look at loads.
> >> I have found all but Liverpool and RHUL for today's tests
> >> Does anyone know have a link to these (If they are already in the
> gridpp
> >> wiki then I can not find them...)
> >> Brian
> >>
> >> -----Original Message-----
> >> From: Testbed Support for GridPP member institutes
> >> [mailto:[log in to unmask]] On Behalf Of Graeme Stewart
> >> Sent: 24 November 2008 21:27
> >> To: [log in to unmask]
> >> Subject: Re: Analysis challenge in the UK tomorrow
> >>
> >> On Mon, Nov 24, 2008 at 2:44 PM, Graeme Stewart
> >> <[log in to unmask]> wrote:
> >>
> >>> Dear All
> >>>
> >>> We intend to start an ATLAS analysis challenge tomorrow at the
> >>> following UK sites:
> >>>
> >>> UKI-LT2-RHUL
> >>> UKI-NORTHGRID-LANCS-HEP
> >>> UKI-NORTHGRID-LIV-HEP
> >>> UKI-NORTHGRID-SHEF-HEP
> >>> UKI-SCOTGRID-GLASGOW
> >>> UKI-SOUTHGRID-OX-HEP
> >>> UKI-SOUTHGRID-RALPP
> >>>
> >>> This will involve the submission of several hundred 'real' ATLAS
> >>> analysis jobs via the WMS. We would kindly ask the sites to keep
an
> >>> eye on their systems during this test and report any problems they
> >>> see. In particular we should like you to be alert for saturation
of
> >>> the network between your storage and the worker nodes. If you can
> grab
> >>>
> >>> any ganglia plots of activity or any other interesting metrics
from
> >>> your side we would be grateful.
> >>>
> >>> The jobs should be submitted in the morning (probably about 10am)
> but
> >>> I will send another alert when this actually happens.
> >>>
> >> Hi
> >>
> >> The jobs are set to go at 9am tomorrow (UK time), so gulp down that
> >> coffee quickly :-)
> >>
> >> Dan has setup some trial monitoring here:
> >>
> >> http://gangarobot.cern.ch/st/
> >>
> >> where results will be posted as the jobs finish.
> >>
> >> Cheers
> >>
> >> Graeme
> >>
> >> --
> >> Dr Graeme Stewart
http://www.physics.gla.ac.uk/~graeme/
> >> Department of Physics and Astronomy, University of Glasgow,
Scotland
> >> --
> >> Scanned by iCritical.
> >>
> >>
> >
> >
> >
> >
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
--
Scanned by iCritical.
|